Classification of schizophrenia based on RAnet-ET: resnet based attention network for eye-tracking.

Journal: Journal of neural engineering
PMID:

Abstract

There is a notable need of quantifiable and objective methods for the classification of schizophrenia. Patients with schizophrenia exhibit atypical eye movements compared with healthy individuals. To address this need, we have developed a classification model based on eye-tracking (ET) data to assist physicians in the intelligent auxiliary diagnosis of schizophrenia.This study employed three ET experiments-picture-free viewing, smooth pursuit tracking, and fixation stability-to collect ET data from patients with schizophrenia and healthy controls. The ET data of 292 participants (133 healthy controls and 159 patients with schizophrenia) were recorded. Utilizing ET data in picture-free viewing, we introduce a Resnet-based Attention Network for ET (RAnet-ET) integrated with the attention mechanism. RAnet-ET was trained by employing multiple loss functions to classify patients with schizophrenia and healthy controls. Furthermore, we proposed a classifier for handling multimodal features that combines specific features extracted from the well-trained RAnet-ET, 100 ET variables extracted from three ET experiments, and 19 MATRICS Consensus Cognitive Battery scores.The RAnet-ET achieved good performance in classifying schizophrenia, yielding an accuracy of 89.04%, a specificity of 90.56%, and an F1 score of 87.87%. The classification results based on multimodal features demonstrated improved performance, achieving 96.37% accuracy, 96.87% sensitivity, 95.87% specificity, and 96.37% F1 score.By integrating attention mechanisms, we designed RAnet-ET, which achieved good performance in classifying schizophrenia from free-viewing ET data. The synergistic combination of specific features extracted from the well-trained RAnet-ET, MCCB scores, and ET variables achieved exceptional classification performance, distinguishing individuals with schizophrenia from healthy controls. This study underscores the potential of our approach as a pivotal asset for the diagnosis of schizophrenia.

Authors

  • Ruochen Dang
    Key Laboratory of Spectral Imaging Technology, Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi'an, China; University of Chinese Academy of Sciences, Beijing, China; Key Laboratory of Biomedical Spectroscopy of Xi'an, Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi'an, China.
  • Ying Wang
    Key Laboratory of Macromolecular Science of Shaanxi Province, School of Chemistry & Chemical Engineering, Shaanxi Normal University, Xi'an, Shaanxi 710062, China.
  • Feiyu Zhu
  • Xiaoyi Wang
    Department of Diagnostic Radiology, National Cancer Center/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing 100021, China.
  • Jingping Zhao
    Department of Psychiatry of the Second Xiangya Hospital, Central South University, Changsha, Hunan 410011, China; Mental Health Institute of the Second Xiangya Hospital, Central South University, Changsha, Hunan, China; National Clinical Research Center on Mental Disorders, Changsha, Hunan, China; National Technology Institute on Mental Disorders, Changsha, Hunan, China; Hunan Key Laboratory of Psychiatry and Mental Health, Changsha, Hunan, China. Electronic address: zhaojingpingcsu@163.com.
  • Ping Shao
    National Clinical Research Center for Mental Disorders, and Department of Psychaitry, The Second Xiangya Hospital of Central South University, 139 Middle Renmin Road, Changsha 410011, Hunan, People's Republic of China.
  • Bing Lang
    National Clinical Research Center for Mental Disorders, and Department of Psychaitry, The Second Xiangya Hospital of Central South University, 139 Middle Renmin Road, Changsha 410011, Hunan, People's Republic of China.
  • Yuqi Wang
    Graduate School at Shenzhen, Tsinghua University, Shenzhen, Guangdong, P.R. China.
  • Zhibin Pan
    School of Electronic and Information Engineering, Xi'an Jiaotong University, Xi'an 710049, People's Republic of China.
  • Bingliang Hu
    Xi'an Institute of Optics and Precision Mechanics of Chinese Academy of Sciences, Xi'an, 710049, China. hbl@opt.ac.cn.
  • Renrong Wu
    Department of Psychiatry of the Second Xiangya Hospital, Central South University, Changsha, Hunan 410011, China; Mental Health Institute of the Second Xiangya Hospital, Central South University, Changsha, Hunan, China; National Clinical Research Center on Mental Disorders, Changsha, Hunan, China; National Technology Institute on Mental Disorders, Changsha, Hunan, China; Hunan Key Laboratory of Psychiatry and Mental Health, Changsha, Hunan, China.
  • Quan Wang
    Laboratory of Surgical Oncology, Peking University People's Hospital, Peking University, Beijing, China.