EEG-Deformer: A Dense Convolutional Transformer for Brain-Computer Interfaces.

Journal: IEEE journal of biomedical and health informatics
PMID:

Abstract

Effectively learning the temporal dynamics in electroencephalogram (EEG) signals is challenging yet essential for decoding brain activities using brain-computer interfaces (BCIs). Although Transformers are popular for their long-term sequential learning ability in the BCI field, most methods combining Transformers with convolutional neural networks (CNNs) fail to capture the coarse-to-fine temporal dynamics of EEG signals. To overcome this limitation, we introduce EEG-Deformer, which incorporates two main novel components into a CNN-Transformer: (1) a Hierarchical Coarse-to-Fine Transformer (HCT) block that integrates a Fine-grained Temporal Learning (FTL) branch into Transformers, effectively discerning coarse-to-fine temporal patterns; and (2) a Dense Information Purification (DIP) module, which utilizes multi-level, purified temporal information to enhance decoding accuracy. Comprehensive experiments on three representative cognitive tasksâcognitive attention, driving fatigue, and mental workload detectionâconsistently confirm the generalizability of our proposed EEG-Deformer, demonstrating that it either outperforms or performs comparably to existing state-of-the-art methods. Visualization results show that EEG-Deformer learns from neurophysiologically meaningful brain regions for the corresponding cognitive tasks.

Authors

  • Yi Ding
    Clinical and Research Center of AIDS, Beijing Ditan Hospital, Capital Medical University, Beijing, China.
  • Yong Li
    Department of Surgical Sciences, Western Michigan University Homer Stryker M.D. School of Medicine, Kalamazoo, MI, United States.
  • Hao Sun
    Department of Gastrointestinal Surgery, Harbin Medical University Cancer Hospital, Harbin, China.
  • Rui Liu
    School of Education, China West Normal University, Nanchong, Sichuan, China.
  • Chengxuan Tong
  • Chenyu Liu
    Party and Government Office, the Second Affiliated Hospital of Dalian Medical University, Dalian 116027, Liaoning, China.
  • Xinliang Zhou
    School of Physical Education, Xihua University, Chengdu, Sichuan 610039, China.
  • Cuntai Guan