Performance of ChatGPT on the Chinese Postgraduate Examination for Clinical Medicine: Survey Study.

Journal: JMIR medical education
Published Date:

Abstract

BACKGROUND: ChatGPT, an artificial intelligence (AI) based on large-scale language models, has sparked interest in the field of health care. Nonetheless, the capabilities of AI in text comprehension and generation are constrained by the quality and volume of available training data for a specific language, and the performance of AI across different languages requires further investigation. While AI harbors substantial potential in medicine, it is imperative to tackle challenges such as the formulation of clinical care standards; facilitating cultural transitions in medical education and practice; and managing ethical issues including data privacy, consent, and bias.

Authors

  • Peng Yu
    College of Life Science, Northwest Normal University, Lanzhou, 730070, Gansu, People's Republic of China.
  • Changchang Fang
    Department of Endocrine, The Second Affiliated Hospital of Nanchang University, Jiangxi, China.
  • Xiaolin Liu
    Department of Physics, Shanghai University of Electric Power, Shanghai 200090, China. Electronic address: xlliu@shiep.edu.cn.
  • Wanying Fu
    Department of Endocrine, The Second Affiliated Hospital of Nanchang University, Jiangxi, China.
  • Jitao Ling
    Department of Endocrine, The Second Affiliated Hospital of Nanchang University, Jiangxi, China.
  • Zhiwei Yan
    College of Kinesiology, Shenyang Sport University, Shenyang, China.
  • Yuan Jiang
    Beijing Smart Tree Medical Technology co. Ltd., Beijing, China.
  • Zhengyu Cao
    Department of Cardiology, Sun Yat-sen Memorial Hospital of Sun Yat-sen University, Guangzhou, China.
  • Maoxiong Wu
    Department of Cardiology, Sun Yat-sen Memorial Hospital of Sun Yat-sen University, Guangzhou, China.
  • Zhiteng Chen
    Department of Cardiology, Sun Yat-sen Memorial Hospital of Sun Yat-sen University, Guangzhou, China.
  • Wengen Zhu
    Department of Cardiology, The First Affiliated Hospital of Sun Yat-sen University, Guangzhou, China.
  • Yuling Zhang
    Department of Radiology, Tianjin First Central Hospital, Tianjin, China.
  • Ayiguli Abudukeremu
    Department of Cardiology, Sun Yat-sen Memorial Hospital of Sun Yat-sen University, Guangzhou, China.
  • Yue Wang
    Department of Pharmacology, University of North Carolina at Chapel Hill, Chapel Hill, NC, United States.
  • Xiao Liu
  • Jingfeng Wang
    Department of Cardiology, Sun Yat-sen Memorial Hospital of Sun Yat-sen University, Guangzhou 510120, China. Electronic address: dr_wjf@hotmail.com.