Machine Learning-Enabled Emotion Recognition by Multisource Throat Signals.

Journal: ACS nano
Published Date:

Abstract

Emotion monitoring plays a crucial role in mental health management. However, traditional methods of emotion recognition predominantly rely on subjective questionnaires or facial expression analyses, which are often inadequate for continuous and highly accurate monitoring. In this study, we propose a high-precision, fine-grained emotion recognition system based on multisource throat physiological signals. The system collects signals through optimized flexible multiporous skin sensors and analyzes them using machine learning models capable of efficiently capturing complex feature interactions. First, we adopt a two-step cross-linking strategy to modulate the porous structure of the sensitive layer to enable accurate detection of the diverse and weak physiological signals in the throat. By extracting four-dimensional features from the input of 7025 samples, the platform based on the Light Gradient Boosting Machine (LightGBM) efficiently captures their nonlinear interactions, ultimately achieving precise classification of five emotional states (relaxation, surprise, disgust, fear, and neutral) with an accuracy of 98.9%. Further validation on an independent data set reveals an average emotion recognition accuracy of 99.3%, demonstrating the system's robustness and reliability in real-world applications. This work provides a viable technological solution for real-time and continuous emotion monitoring, offering significant potential in mental health management and related fields.

Authors

  • Jing-Hui Mao
    State Key Laboratory of Advanced Technology for Materials Synthesis and Processing, Center of Smart Materials and Devices, Wuhan University of Technology, Wuhan 430070, China.
  • Zhong-Hui Shen
    State Key Laboratory of Advanced Technology for Materials Synthesis and Processing, Center of Smart Materials and Devices, Wuhan University of Technology, Wuhan 430070, China.
  • Jian Wang
    Veterinary Diagnostic Center, Shanghai Animal Disease Control Center, Shanghai, China.
  • Run-Lin Liu
    School of Materials and Microelectronics, Wuhan University of Technology, Wuhan 430070, China.
  • Xiao-Fei Liu
    State Key Laboratory of Advanced Technology for Materials Synthesis and Processing, Center of Smart Materials and Devices, Wuhan University of Technology, Wuhan 430070, China.
  • Ying Lan
    School of Materials and Microelectronics, Wuhan University of Technology, Wuhan 430070, China.
  • Mengjun Zhou
    State Key Laboratory of Advanced Technology for Materials Synthesis and Processing, Center of Smart Materials and Devices, Wuhan University of Technology, Wuhan 430070, China.
  • Jian-Yong Jiang
    Wuzhen Laboratory, Tongxiang 314500, China.
  • Yang Shen
    Departments of Electrical and Computer Engineering & Computer Science and Engineering Texas A&M University, College Station, TX 77840.
  • Ce-Wen Nan
    State Key Laboratory of New Ceramics and Fine Processing, School of Materials Science and Engineering, Tsinghua University, Beijing 100084, China.