Multimodal depression recognition and analysis: Facial expression and body posture changes via emotional stimuli.

Journal: Journal of affective disorders
PMID: 40187420

Abstract

BACKGROUND: Clinical studies have shown that facial expressions and body posture in depressed patients differ significantly from those of healthy individuals. Combining relevant behavioral features with artificial intelligence technology can effectively improve the efficiency of depression detection, thereby assisting doctors in early identification of patients. This study aims to develop an end-to-end multimodal recognition model combining facial expressions and body posture via deep learning techniques, enabling rapid preliminary screening of depression.

Authors

  • Yang Liu
    Department of Computer Science, Hong Kong Baptist University, Hong Kong, China.
  • Xingyun Li
    Gansu Provincial Key Laboratory of Wearable Computing, School of Information Science and Engineering, Lanzhou University, Lanzhou 730000, China.
  • Mengqi Wang
    Key Laboratory of Computing Power Network and Information Security, Ministry of Education, Qilu University of Technology (Shandong Academy of Science), Jinan 250353, China.
  • Jianlu Bi
    Endocrinology, The Fifth Clinical College of Guangzhou University of Chinese Medicine, Guangzhou 510095, China; Endocrinology, Guangdong Provincial Second Hospital of Traditional Chinese Medicine, Guangzhou 510095, China.
  • Shaoqin Lin
    Endocrinology, The Fifth Clinical College of Guangzhou University of Chinese Medicine, Guangzhou 510095, China; Endocrinology, Guangdong Provincial Second Hospital of Traditional Chinese Medicine, Guangzhou 510095, China.
  • Qingxiang Wang
    School of Computer Science and Technology, Qilu University of Technology (Shandong Academy of Sciences), Jinan, China. wangqx@qlu.edu.cn.
  • Yanhong Yu
    College of Traditional Chinese Medicine, Shandong University of Traditional Chinese Medicine, Jinan, China. yhysdutcm@163.com.
  • Jiayu Ye
    Key Laboratory of Computing Power Network and Information Security, Ministry of Education, Qilu University of Technology (Shandong Academy of Science), Jinan 250353, China; School of Computer Science, Guangdong University of Technology, Guangzhou 510006, China. Electronic address: yejiayu97@outlook.com.
  • Yunshao Zheng
    Shandong Mental Health Center, Shandong University, Jinan 250014, China.

Keywords

External Resources

Popular Topics
Recent Journals