AADNet: Exploring EEG Spatiotemporal Information for Fast and Accurate Orientation and Timbre Detection of Auditory Attention Based on a Cue-Masked Paradigm.

Journal: IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society
PMID:

Abstract

Auditory attention decoding from electroencephalogram (EEG) could infer to which source the user is attending in noisy environments. Decoding algorithms and experimental paradigm designs are crucial for the development of technology in practical applications. To simulate real-world scenarios, this study proposed a cue-masked auditory attention paradigm to avoid information leakage before the experiment. To obtain high decoding accuracy with low latency, an end-to-end deep learning model, AADNet, was proposed to exploit the spatiotemporal information from the short time window of EEG signals. The results showed that with a 0.5-second EEG window, AADNet achieved an average accuracy of 93.46% and 91.09% in decoding auditory orientation attention (OA) and timbre attention (TA), respectively. It significantly outperformed five previous methods and did not need the knowledge of the original audio source. This work demonstrated that it was possible to detect the orientation and timbre of auditory attention from EEG signals fast and accurately. The results are promising for the real-time multi-property auditory attention decoding, facilitating the application of the neuro-steered hearing aids and other assistive listening devices.

Authors

  • Keren Shi
  • Xu Liu
    School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore 639798, Singapore. liuxu16@bjut.edu.cn.
  • Xue Yuan
    Academy of Medical Engineering and Translational Medicine, Medical College, Tianjin University, Tianjin 300072, China.
  • Haijie Shang
  • Ruiting Dai
  • Hanbin Wang
  • Yunfa Fu
    Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, China.
  • Ning Jiang
  • Jiayuan He