An auto-segmented multi-time window dual-scale neural network for brain-computer interfaces based on event-related potentials.

Journal: Journal of neural engineering
Published Date:

Abstract

Event-related potentials (ERPs) are cerebral responses to cognitive processes, also referred to as cognitive potentials. Accurately decoding ERPs can help to advance research on brain-computer interfaces (BCIs). The spatial pattern of ERP varies with time. In recent years, convolutional neural networks (CNNs) have shown promising results in electroencephalography (EEG) classification, specifically for ERP-based BCIs.This study proposes an auto-segmented multi-time window dual-scale neural network (AWDSNet). The combination of a multi-window design and a lightweight base network gives AWDSNet good performance at an acceptable cost of computing. For each individual, we create a time window set by calculating the correlation of signed-squared values, which enables us to determine the length and number of windows automatically. The signal data are segmented based on the obtained window sets in sub-plus-global mode. Then, the multi-window data are fed into a dual-scale CNN model, where the sizes of the convolution kernels are determined by the window sizes. The use of dual-scale spatiotemporal convolution focuses on feature details while also having a large enough receptive length, and the grouping parallelism undermines the increase in the number of parameters that come with dual scaling.We evaluated the performance of AWDSNet on a public dataset and a self-collected dataset. A comparison was made with four popular methods including EEGNet, DeepConvNet, EEG-Inception, and PPNN. The experimental results show that AWDSNet has excellent classification performance with acceptable computational complexity.These results indicate that AWDSNet has great potential for applications in ERP decoding.

Authors

  • Xueqing Zhao
  • Ren Xu
    East China Sea Environmental Monitoring Center, Shanghai, 310058, China.
  • Ruitian Xu
    Key Laboratory of Smart Manufacturing in Energy Chemical Process, Ministry of Education, East China University of Science and Technology, Shanghai 200237, People's Republic of China.
  • Xingyu Wang
    1 Key Laboratory for Advanced Control and Optimization for Chemical Processes, East China University of Science and Technology, Shanghai, P. R. China.
  • Andrzej Cichocki
  • Jing Jin
    College of Rehabilitation Medicine, Fujian University of Traditional Chinese Medicine, Fuzhou, China.