MetaGP: A generative foundation model integrating electronic health records and multimodal imaging for addressing unmet clinical needs.

Journal: Cell reports. Medicine
PMID: 40187356

Abstract

Artificial intelligence makes strides in specialized diagnostics but faces challenges in complex clinical scenarios, such as rare disease diagnosis and emergency condition identification. To address these limitations, we develop Meta General Practitioner (MetaGP), a 32-billion-parameter generative foundation model trained on extensive datasets, including over 8 million electronic health records, biomedical literature, and medical textbooks. MetaGP demonstrates robust diagnostic capabilities, achieving accuracy comparable to experienced clinicians. In rare disease cases, it achieves an average diagnostic score of 1.57, surpassing GPT-4's 0.93. For emergency conditions, it improves diagnostic accuracy for junior and mid-level clinicians by 53% and 46%, respectively. MetaGP also excels in generating medical imaging reports, producing high-quality outputs for chest X-rays and computed tomography, often rated comparable to or superior to physician-authored reports. These findings highlight MetaGP's potential to transform clinical decision-making across diverse medical contexts.

Authors

  • Fei Liu
    Department of Interventional Radiology, Qinghai Red Cross Hospital, Xining, Qinghai, China.
  • Hongyu Zhou
    Institute for AI in Medicine and Faculty of Medicine, Macau University of Science and Technology, Macau, China; National Clinical Research Center for Ocular Diseases, Eye Hospital, Wenzhou Medical University, Wenzhou, China.
  • Kai Wang
    Department of Rheumatology, The Affiliated Huai'an No. 1 People's Hospital of Nanjing Medical University, Huai'an, Jiangsu, China.
  • Yunfang Yu
    Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Guangdong-Hong Kong Joint Laboratory for RNA Medicine, Department of Medical Oncology, Breast Tumor Centre, Phase I Clinical Trial Centre, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China; Guangdong Provincial Key Laboratory of Cancer Pathogenesis and Precision Diagnosis and Treatment, Joint Big Data Laboratory, Department of Medical Oncology, Shenshan Medical Center, Memorial Hospital of Sun Yat-sen University, Shanwei, China; Institute for AI in Medicine and faculty of Medicine, Macau University of Science and Technology, Taipa, Macao, China; Department of Breast Surgery, The First Affiliated Hospital, Jinan University, Guangzhou, China.
  • Yuanxu Gao
    Institute for AI in Medicine and Faculty of Medicine, Macau University of Science and Technology, Macau, China; State Key Laboratory of Eye Health, Eye Hospital and Institute for Advanced Study on Eye Health and Diseases, Wenzhou Medical University, Wenzhou, China; National Clinical Research Center for Ocular Diseases, Eye Hospital, Wenzhou Medical University, Wenzhou, China; Department of Big Data and Biomedical AI, College of Future Technology, Peking University and Peking-Tsinghua Center for Life Sciences, Beijing, China.
  • Zhuo Sun
    State Key Laboratory of Eye Health, Eye Hospital and Institute for Advanced Study on Eye Health and Diseases, Wenzhou Medical University, Wenzhou, China; Department of Ophthalmology, The Third People's Hospital of Changzhou, Changzhou, China.
  • Sian Liu
    State Key Laboratory of Eye Health, Eye Hospital and Institute for Advanced Study on Eye Health and Diseases, Wenzhou Medical University, Wenzhou, China; National Clinical Research Center for Ocular Diseases, Eye Hospital, Wenzhou Medical University, Wenzhou, China.
  • Shanshan Sun
    Shandong Institute for Food and Drug Control, Ji'nan 250101, China.
  • Zixing Zou
    Institute for AI in Medicine and Faculty of Medicine, Macau University of Science and Technology, Macau, China; State Key Laboratory of Eye Health, Eye Hospital and Institute for Advanced Study on Eye Health and Diseases, Wenzhou Medical University, Wenzhou, China; National Clinical Research Center for Ocular Diseases, Eye Hospital, Wenzhou Medical University, Wenzhou, China; Guangzhou National Laboratory, Guangzhou, China.
  • Zhuomin Li
    State Key Laboratory of Eye Health, Eye Hospital and Institute for Advanced Study on Eye Health and Diseases, Wenzhou Medical University, Wenzhou, China; National Clinical Research Center for Ocular Diseases, Eye Hospital, Wenzhou Medical University, Wenzhou, China.
  • Bingzhou Li
    State Key Laboratory of Eye Health, Eye Hospital and Institute for Advanced Study on Eye Health and Diseases, Wenzhou Medical University, Wenzhou, China; National Clinical Research Center for Ocular Diseases, Eye Hospital, Wenzhou Medical University, Wenzhou, China.
  • Hanpei Miao
    Dongguan Hospital, Southern Medical University, Dongguan, China.
  • Yang Liu
    Department of Computer Science, Hong Kong Baptist University, Hong Kong, China.
  • Taiwa Hou
    Conde S. Januário Hospital, Macau, China.
  • Manson Fok
    Institute for AI in Medicine and Faculty of Medicine, Macau University of Science and Technology, Macau, China.
  • Nivritti Gajanan Patil
    Institute for AI in Medicine and Faculty of Medicine, Macau University of Science and Technology, Macau, China.
  • Kanmin Xue
    Nuffield Department of Neuroscience, Oxford University, Oxford, UK.
  • Ting Li
    Institute of Biomedical Engineering, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China.
  • Eric Oermann
    NYU Langone Medical Center, New York University, New York, NY, USA.
  • Yun Yin
    Faculty of Health and Wellness, Faculty of Business, City University of Macau, Macau, China.
  • Lian Duan
    Department of Medical Informatics, Nantong University, Nantong, Jiangsu, China.
  • Jia Qu
    National Clinical Research Center for Ocular Diseases, Eye Hospital, Wenzhou Medical University, Wenzhou, China. Electronic address: jia.qu@163.com.
  • Xiaoying Huang
    Division of Pulmonary Medicine, the First Affiliated Hospital, Wenzhou Medical University, Wenzhou Key Laboratory of Interdisciplinary and Translational Medicine, Wenzhou Key Laboratory of Heart and Lung, Wenzhou, Zhejiang, China. Electronic address: huangxiaoying@wzhospital.cn.
  • Shengwei Jin
    Department of Anesthesia and Critical Care, The Second Affiliated Hospital and Yuying Children's Hospital of Wenzhou Medical University, Key Laboratory of Pediatric Anesthesiology, Ministry of Education, Wenzhou Medical University, Wenzhou, Zhejiang, China. Electronic address: jsw@wmu.edu.cn.
  • Kang Zhang
    Xifeng District People's Hospital, Qingyang, China.

Keywords

External Resources

Popular Topics
Recent Journals