Partial directed coherence based graph convolutional neural networks for driving fatigue detection.

Journal: The Review of scientific instruments
Published Date:

Abstract

The mental state of a driver can be accurately and reliably evaluated by detecting the driver's electroencephalogram (EEG) signals. However, traditional machine learning and deep learning methods focus on the single electrode feature analysis and ignore the functional connection of the brain. In addition, the recent brain function connection network method needs to manually extract substantial brain network features, which results in cumbersome operation. For this reason, this paper introduces graph convolution combined with brain function connection theory into the study of mental fatigue and proposes a method for driving fatigue detection based on the partial directed coherence graph convolutional neural network (PDC-GCNN), which can analyze the characteristics of single electrodes while automatically extracting the topological features of the brain network. We designed a fatigue driving simulation experiment and collected the EEG signals. In the present work, the PDC method constructs the adjacency matrix to describe the relationship between EEG channels, and the GCNN combines single-electrode local brain area information and brain area connection information to further improve the performance of detecting fatigue states. Based on the features of differential entropy (DE) and power spectral density (PSD), the average recognition accuracy of ten-fold cross validation is 84.32% and 83.84%, respectively. For further experiments on each subject, the average recognition results are 95.24%/5.10% (PSD) and 96.01%/3.81% (DE). This research can be embedded in the vehicle driving fatigue detection system, which has practical application value.

Authors

  • Weiwei Zhang
    Department of Laboratory Medicine, Affiliated Hospital of Nantong University, Nantong, Jiangsu, China.
  • Fei Wang
    Department of Population Health Sciences, Weill Cornell Medicine, Cornell University, New York, NY, United States.
  • Shichao Wu
    Faculty of Robot Science and Engineering, Northeastern University, No. 195, Innovation Road, Hunnan District, Shenyang, People's Republic of China.
  • Zongfeng Xu
    College of Information Science and Engineering, Northeastern University, No. 3-11, Wenhua Road, Heping District, Shenyang, People's Republic of China.
  • Jingyu Ping
    Faculty of Robot Science and Engineering, Northeastern University, No. 195, Innovation Road, Hunnan District, Shenyang, People's Republic of China.
  • Yang Jiang
    Department of Ophthalmology Peking Union Medical College Hospital, Peking Union Medical College, Chinese Academy of Medical Sciences Beijing People's Republic of China.