Multi-scale convolutional transformer network for motor imagery brain-computer interface.

Journal: Scientific reports
PMID:

Abstract

Brain-computer interface (BCI) systems allow users to communicate with external devices by translating neural signals into real-time commands. Convolutional neural networks (CNNs) have been effectively utilized for decoding motor imagery electroencephalography (MI-EEG) signals in BCIs. However, traditional CNN-based methods face challenges such as individual variability in EEG signals and the limited receptive fields of CNNs. This study presents the Multi-Scale Convolutional Transformer (MSCFormer) model that integrates multiple CNN branches for multi-scale feature extraction and a Transformer module to capture global dependencies, followed by a fully connected layer for classification. The multi-branch multi-scale CNN structure effectively addresses individual variability in EEG signals, enhancing the model's generalization capabilities, while the Transformer encoder strengthens global feature integration and improves decoding performance. Extensive experiments on the BCI IV-2a and IV-2b datasets show that MSCFormer achieves average accuracies of 82.95% (BCI IV-2a) and 88.00% (BCI IV-2b), with kappa values of 0.7726 and 0.7599 in five-fold cross-validation, surpassing several state-of-the-art methods. These results highlight MSCFormer's robustness and accuracy, underscoring its potential in EEG-based BCI applications. The code has been released in https://github.com/snailpt/MSCFormer .

Authors

  • Wei Zhao
    Key Laboratory of Synthetic and Biological Colloids, Ministry of Education, Jiangnan University, Wuxi 214122, Jiangsu Province, P. R. China. lxy@jiangnan.edu.cn zhuye@jiangnan.edu.cn.
  • Baocan Zhang
    Chengyi University College, Jimei University, Xiamen 361021, China.
  • Haifeng Zhou
    Department of Mechanical and Electrical Engineering, Soochow University, Suzhou, Jiangsu, China.
  • Dezhi Wei
    Chengyi College, Jimei University, Xiamen, 361021, China.
  • Chenxi Huang
    Center for Outcomes Research and Evaluation, Yale-New Haven Hospital, New Haven, Connecticut, United States of America.
  • Quan Lan
    Department of Neurology, First Affiliated Hospital of Xiamen University, Xiamen, 361003, People's Republic of China.