Utility of artificial intelligence-based conversation voice analysis for detecting cognitive decline.

Journal: PloS one
Published Date:

Abstract

Recent developments in artificial intelligence (AI) have introduced new technologies that can aid in detecting cognitive decline. This study developed a voice-based AI model that screens for cognitive decline using only a short conversational voice sample. The process involved collecting voice samples, applying machine learning (ML), and confirming accuracy through test data. The AI model extracts multiple voice features from the collected voice data to detect potential signs of cognitive impairment. Data labeling for ML was based on Mini-Mental State Examination scores: scores of 23 or lower were labeled as "cognitively declined (CD)," while scores above 24 were labeled as "cognitively normal (CN)." A fully coupled neural network architecture was employed for deep learning, using voice samples from 263 patients. Twenty voice samples, each comprising a one-minute conversation, were used for accuracy evaluation. The developed AI model achieved an accuracy of 0.950 in discriminating between CD and CN individuals, with a sensitivity of 0.875, specificity of 1.000, and an average area under the curve of 0.990. This voice AI model shows promise as a cognitive screening tool accessible via mobile devices, requiring no specialized environments or equipment, and can help detect CD, offering individuals the opportunity to seek medical attention.

Authors

  • Takeshi Kuroda
    Department of Neurology, Showa University School of Medicine, Tokyo, Japan.
  • Kenjiro Ono
    Department of Neurology, Kanazawa University Graduate School of Medical Sciences, Kanazawa, Japan.
  • Masaki Onishi
    ExaWizards Inc., Tokyo, Japan.
  • Kouzou Murakami
    Department of Radiology, Showa University School of Medicine, Tokyo, Japan.
  • Daiki Shoji
    Department of Neurology, Showa University School of Medicine, Tokyo, Japan.
  • Shota Kosuge
    Department of Neurology, Showa University School of Medicine, Tokyo, Japan.
  • Atsushi Ishida
    Department of Neurology, Showa University School of Medicine, Tokyo, Japan.
  • Sotaro Hieda
    Department of Neurology, Showa University School of Medicine, Tokyo, Japan.
  • Masato Takahashi
    Graduate School of Health Sciences, Ibaraki Prefectural University of Health Sciences, Ibaraki, Japan.
  • Hisashi Nakashima
    ExaWizards Inc., Tokyo, Japan.
  • Yoshinori Ito
    Department of Radiation Oncology, National Cancer Center Hospital, Tokyo, Japan.
  • Hidetomo Murakami
    Department of Neurology, Showa University School of Medicine, Tokyo, Japan.