Multimodal Integration in Health Care: Development With Applications in Disease Management.

Journal: Journal of medical Internet research
Published Date:

Abstract

Multimodal data integration has emerged as a transformative approach in the health care sector, systematically combining complementary biological and clinical data sources such as genomics, medical imaging, electronic health records, and wearable device outputs. This approach provides a multidimensional perspective of patient health that enhances the diagnosis, treatment, and management of various medical conditions. This viewpoint presents an overview of the current state of multimodal integration in health care, spanning clinical applications, current challenges, and future directions. We focus primarily on its applications across different disease domains, particularly in oncology and ophthalmology. Other diseases are briefly discussed due to the few available literature. In oncology, the integration of multimodal data enables more precise tumor characterization and personalized treatment plans. Multimodal fusion demonstrates accurate prediction of anti-human epidermal growth factor receptor 2 therapy response (area under the curve=0.91). In ophthalmology, multimodal integration through the combination of genetic and imaging data facilitates the early diagnosis of retinal diseases. However, substantial challenges remain regarding data standardization, model deployment, and model interpretability. We also highlight the future directions of multimodal integration, including its expanded disease applications, such as neurological and otolaryngological diseases, and the trend toward large-scale multimodal models, which enhance accuracy. Overall, the innovative potential of multimodal integration is expected to further revolutionize the health care industry, providing more comprehensive and personalized solutions for disease management.

Authors

  • Yan Hao
    Department of Plastic Surgery, Peking Union Medical College Hospital, Beijing, China.
  • Chao Cheng
    Department of Molecular and Systems Biology, Lebanon, USA. Chao.Cheng@bcm.edu.
  • Juanjuan Li
    School of Mechanical Electronic & Information Engineering, China University of Mining and Technology (Beijing), Beijing 100083, China. lantianljj@163.com.
  • Hongwen Li
    Basic Medicine College, Nanyang Medical University, Nanyang 473061, China.
  • Xingsi Di
    School of Law, Guangzhou University, Guangzhou, Guangdong, China.
  • Xiaoxia Zeng
    Department of Otolaryngology, Longgang Otolaryngology hospital & Shenzhen Key Laboratory of Otolaryngology, Shenzhen Institute of Otolaryngology, Shenzhen, Guangdong, China.
  • Shoumei Jin
    Department of Ophthalmology, Shenzhen Longgang Otolaryngology Hospital & Shenzhen Otolaryngology Research Institute, Shenzhen, Guangdong, China.
  • Xiaodong Han
    Innovation Center for Neurological Disorders and Department of Neurology, Xuanwu Hospital, Capital Medical University, National Clinical Research Center for Geriatric Diseases, Beijing, China.
  • Chongsong Liu
    Department of Otolaryngology, Shenzhen Longgang Otolaryngology Hospital & Shenzhen Otolaryngology Research Institute, 186 Huangge Road, Longcheng Subdistrict, Longgang District, Shenzhen, Guangdong, 518172, China, 86 (755)28989999.
  • Qianqian Wang
    School of Teacher Education, Zhejiang Normal University, Jinhua, China.
  • Bingying Luo
    Department of Immunology, Tianjin Medical University, Tianjin, China.
  • Xianhai Zeng
    Department of Otolaryngology, Longgang Otolaryngology hospital & Shenzhen Key Laboratory of Otolaryngology, Shenzhen Institute of Otolaryngology, Shenzhen, Guangdong, China.
  • Ke Li
    School of Ideological and Political Education, Shanghai Maritime University, Shanghai, China.