A research team from Penn State has developed a novel hybrid device that integrates distinct sensors with a flexible wireless power supply and an emotional recognition transmission module.
Wearable patches can accurately track multiple emotional signals at the same time. Image credit: Yangbo Yuan/Penn State.
“This represents a new and enhanced method for understanding our emotions by observing various body signals simultaneously,” stated Dr. Hua New Larry’Chen of Pennsylvania.
“Relying solely on facial expressions for emotional understanding can often be misleading.”
“Many people do not always express how they truly feel, so combining analyses of expression with other significant physiological signals can ultimately enhance mental health monitoring and support.”
The sticker-like patches monitor various physiological responses, including skin temperature, humidity, heart rate, and blood oxygen levels linked to emotional states.
Crucially, the device’s sensors are designed to function independently, reducing interference among different measurements.
The system integrates the analysis of physiological signals with facial data to better differentiate between authentic and behavioral emotions.
It wirelessly transmits real-time measurement data to your mobile device and cloud, where it could potentially assist clinicians in effectively evaluating patients.
The device does not store personal data; it only records signals, ensuring privacy is safeguarded through its design.
“This technology has the potential to aid individuals facing mental health challenges, especially when they may not be entirely forthcoming about their struggles,” remarked Yambo Yuan, a doctoral student in Pennsylvania.
“The collected data could also help bridge cultural or social divides, which can manifest as a disparity between stoic or expressive presentations to healthcare providers.”
“Tracking these signals could enable early detection of issues like anxiety and depression as they develop.”
Researchers have crafted a flexible device by folding a thin layer of materials such as platinum or gold into a wave-like shape that maintains its sensitivity, even when stretched or twisted.
A layer of material incorporated into a hollow tube made of carbon atoms adjusts current flow with temperature, absorbing moisture and monitoring humidity levels.
Multiple sensors have been designed and positioned on the device to avoid interference with each other’s readings.
For instance, scientists placed a rigid layer underneath the temperature and humidity sensors to protect it from the stretching experienced by the expression sensor.
A waterproof layer was also utilized to shield temperature and strain sensors from humidity.
Dr. Libo Gao, a researcher at Xiamen University, stated:
The authors subsequently trained artificial intelligence (AI) models to interpret and recognize the signs of human emotions exhibited.
They enlisted eight participants, a typical sample size for pilot studies, who expressed six fundamental emotions: happiness, surprise, fear, sadness, anger, and disgust.
Participants showcased each emotional expression 100 times while the device monitored movements.
The researchers then input the data into AI models, training them to link specific facial movements with distinct emotions.
Three additional participants were recruited to further evaluate the model’s effectiveness.
It categorized facial expressions with an impressive accuracy of 96.28%.
In testing the device’s capacity to monitor actual emotions, the scientists assessed how well it recorded the psychological responses of the same participants while viewing video clips designed to evoke emotions.
The device successfully identified emotions with an accuracy of 88.83%, confirming that the psychological responses corresponded with established links between emotions, such as rising skin temperatures and increased heart rates associated with surprise and anger.
“The capability to transmit data wirelessly allows healthcare professionals to remotely monitor individuals and offer timely emotional support through telehealth,” Dr. Chen emphasized.
“The sensor could play a vital role in enhancing access to care.”
“Given the increasing stress levels in contemporary society, monitoring emotions could provide early indicators of debilitating conditions and enable proactive support.”
The device’s development is documented in a paper published in the journal Nano Letters.
____
Yanbo Yuan et al. 2025. Stretchable, rechargeable, multimodal hybrid electronics for isolated sensing for emotional detection. Nano Letters 25 (13): 5220-5230; doi: 10.1021/acs.nanolett.4c06392
Source: www.sci.news
