Emotion Recognition Based on Skin Potential Signals with a Portable Wireless Device.

Journal: Sensors (Basel, Switzerland)
Published Date:

Abstract

Emotion recognition is of great importance for artificial intelligence, robots, and medicine etc. Although many techniques have been developed for emotion recognition, with certain successes, they rely heavily on complicated and expensive equipment. Skin potential (SP) has been recognized to be correlated with human emotions for a long time, but has been largely ignored due to the lack of systematic research. In this paper, we propose a single SP-signal-based method for emotion recognition. Firstly, we developed a portable wireless device to measure the SP signal between the middle finger and left wrist. Then, a video induction experiment was designed to stimulate four kinds of typical emotion (happiness, sadness, anger, fear) in 26 subjects. Based on the device and video induction, we obtained a dataset consisting of 397 emotion samples. We extracted 29 features from each of the emotion samples and used eight well-established algorithms to classify the four emotions based on these features. Experimental results show that the gradient-boosting decision tree (GBDT), logistic regression (LR) and random forest (RF) algorithms achieved the highest accuracy of 75%. The obtained accuracy is similar to, or even better than, that of other methods using multiple physiological signals. Our research demonstrates the feasibility of the SP signal's integration into existing physiological signals for emotion recognition.

Authors

  • Shuhao Chen
    College of Information Science and Electronic Engineering, Zhejiang University, Hangzhou 310027, China.
  • Ke Jiang
    Paul C. Lauterbur Research Centre for Biomedical Imaging, Shenzhen Key Laboratory for MRI, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong, China.
  • Haoji Hu
    College of Information Science and Electronic Engineering, Zhejiang University, Hangzhou 310027, China.
  • Haoze Kuang
    College of Information Science and Electronic Engineering, Zhejiang University, Hangzhou 310027, China.
  • Jianyi Yang
    School of Mathematical Sciences, Nankai University, Tianjin, China.
  • Jikui Luo
    College of Information Science and Electronic Engineering, Zhejiang University, Hangzhou 310027, China.
  • Xinhua Chen
    Zhejiang Key Laboratory for Pulsed Power Tanslational Medicine, Hangzhou Ruidi Biotech Ltd., Hangzhou 310000, China.
  • Yubo Li
    *Tianjin State Key Laboratory of Modern Chinese Medicine, School of Traditional Chinese Materia Medica, Tianjin University of Traditional Chinese Medicine, Tianjin 300193, China and.