[Study on speech imagery electroencephalography decoding of Chinese words based on the CAM-Net model].

Journal: Sheng wu yi xue gong cheng xue za zhi = Journal of biomedical engineering = Shengwu yixue gongchengxue zazhi
Published Date:

Abstract

Speech imagery is an emerging brain-computer interface (BCI) paradigm with potential to provide effective communication for individuals with speech impairments. This study designed a Chinese speech imagery paradigm using three clinically relevant words-"Help me", "Sit up" and "Turn over"-and collected electroencephalography (EEG) data from 15 healthy subjects. Based on the data, a Channel Attention Multi-Scale Convolutional Neural Network (CAM-Net) decoding algorithm was proposed, which combined multi-scale temporal convolutions with asymmetric spatial convolutions to extract multidimensional EEG features, and incorporated a channel attention mechanism along with a bidirectional long short-term memory network to perform channel weighting and capture temporal dependencies. Experimental results showed that CAM-Net achieved a classification accuracy of 48.54% in the three-class task, outperforming baseline models such as EEGNet and Deep ConvNet, and reached a highest accuracy of 64.17% in the binary classification between "Sit up" and "Turn over". This work provides a promising approach for future Chinese speech imagery BCI research and applications.

Authors

  • Xiaolong Liu
    The United Innovation of Mengchao Hepatobiliary Technology Key Laboratory of Fujian Province, Mengchao Hepatobiliary Hospital of Fujian Medical University, Fuzhou, 350025, People's Republic of China.
  • Banghua Yang
    School of Mechatronic Engineering and Automation, Research Center of Brain Computer Engineering, Shanghai University, Shanghai, 200444, China. yangbanghua@126.com.
  • An'an Gan
    School of Mechanical and Electrical Engineering and Automation, Shanghai University, Shanghai 200444, P. R. China.
  • Jie Zhang
    College of Physical Education and Health, Linyi University, Linyi, Shandong, China.