Multimodal machine learning for language and speech markers identification in mental health.

Journal: BMC medical informatics and decision making
PMID:

Abstract

BACKGROUND: There are numerous papers focusing on diagnosing mental health disorders using unimodal and multimodal approaches. However, our literature review shows that the majority of these studies either use unimodal approaches to diagnose a variety of mental disorders or employ multimodal approaches to diagnose a single mental disorder instead. In this research we combine these approaches by first identifying and compiling an extensive list of mental health disorder markers for a wide range of mental illnesses which have been used for both unimodal and multimodal methods, which is subsequently used for determining whether the multimodal approach can outperform the unimodal approaches.

Authors

  • Georgios Drougkas
    Leiden Institute of Advanced Computer Science, Leiden University, Leiden, The Netherlands.
  • Erwin M Bakker
    Leiden Institute of Advanced Computer Science, Leiden University, Leiden, The Netherlands.
  • Marco Spruit
    Department of Computing and Information Sciences, Utrecht University, Utrecht, Netherlands.