3DCANN: A Spatio-Temporal Convolution Attention Neural Network for EEG Emotion Recognition.

Journal: IEEE journal of biomedical and health informatics
Published Date:

Abstract

Since electroencephalogram (EEG) signals can truly reflect human emotional state, emotion recognition based on EEG has turned into a critical branch in the field of artificial intelligence. Aiming at the disparity of EEG signals in various emotional states, we propose a new deep learning model named three-dimension convolution attention neural network (3DCANN) for EEG emotion recognition in this paper. The 3DCANN model is composed of spatio-temporal feature extraction module and EEG channel attention weight learning module, which can extract the dynamic relation well among multi-channel EEG signals and the internal spatial relation of multi-channel EEG signals during continuous period time. In this model, the spatio-temporal features are fused with the weights of dual attention learning, and the fused features are input into the softmax classifier for emotion classification. In addition, we utilize SJTU Emotion EEG Dataset (SEED) to appraise the feasibility and effectiveness of the proposed algorithm. Finally, experimental results display that the 3DCANN method has superior performance over the state-of-the-art models in EEG emotion recognition.

Authors

  • Shuaiqi Liu
    College of Electronic and Information Engineering, Hebei University, Baoding Hebei, China.
  • Xu Wang
    Weldon School of Biomedical Engineering, Purdue University, West Lafayette, IN 47907.
  • Ling Zhao
    School of Acu-Mox and Tuina, Chengdu University of Traditional Chinese Medicine, Chengdu, China.
  • Bing Li
  • Weiming Hu
  • Jie Yu
    Institute of Animal Nutrition, Sichuan Agricultural University, Key Laboratory for Animal Disease-Resistance Nutrition of China Ministry of Education, Key Laboratory of Animal Disease-resistant Nutrition and Feed of China Ministry of Agriculture and Rural Affairs, Key Laboratory of Animal Disease-resistant Nutrition of Sichuan Province, Ya'an, 625014, China.
  • Yu-Dong Zhang
    University of Leicester, Leicester, United Kingdom.