HATNet: EEG-Based Hybrid Attention Transfer Learning Network for Train Driver State Detection.

Journal: IEEE transactions on cybernetics
PMID:

Abstract

Electroencephalography (EEG) is widely utilized for train driver state detection due to its high accuracy and low latency. However, existing methods for driver status detection rarely use the rich physiological information in EEG to improve detection performance. Moreover, there is currently a lack of EEG datasets for abnormal states of train drivers. To address these gaps, we propose a novel transfer learning model based on a hybrid attention mechanism, named hybrid attention-based transfer learning network (HATNet). We first segment the EEG signals into patches and utilize the hybrid attention module to capture local and global temporal patterns. Then, a channel-wise attention module is introduced to establish spatial representations among EEG channels. Finally, during the training process, we employ a calibration-based transfer learning strategy, which allows for adaptation to the EEG data distribution of new subjects using minimal data. To validate the effectiveness of our proposed model, we conduct a multistimulus oddball experiment to establish a EEG dataset of abnormal states for train drivers. Experimental results on this dataset indicate that: 1) Compared to the state-of-the-art end-to-end models, HATNet achieves the highest classification accuracy in both subject-dependent and subject-independent tasks at 94.26% and 87.03%, respectively, and 2) The proposed hybrid attention module effectively captures the temporal semantic information of EEG data.

Authors

  • Shuxiang Lin
  • Chaojie Fan
    Key Laboratory of Traffic Safety on Track (Central South University), Ministry of Education, School of Traffic & Transportation Engineering, Central South University, Changsha, 410075, China; Joint International Research Laboratory of Key Technology for Rail Traffic Safety, Central South University, Changsha, 410000, China. Electronic address: fcjgszx@csu.edu.cn.
  • Demin Han
    Beijing Tongren Hospital, Capital Medical University, Beijing, 100730, People's Republic of China. deminhan_ent@hotmail.com.
  • Ziyu Jia
    Beijing Key Laboratory of Traffic Data Analysis and Mining, School of Computer Science and Technology, Beijing Jiaotong University, Beijing, 100044, China; Brainnetome Center, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China. Electronic address: jia.ziyu@outlook.com.
  • Yong Peng
    Department of Cardiology, West China Hospital, Sichuan University, Chengdu 610041, China.
  • Sam Kwong