Performance of ChatGPT on Chinese national medical licensing examinations: a five-year examination evaluation study for physicians, pharmacists and nurses.

Journal: BMC medical education
PMID: 38355517

Abstract

BACKGROUND: Large language models like ChatGPT have revolutionized the field of natural language processing with their capability to comprehend and generate textual content, showing great potential to play a role in medical education. This study aimed to quantitatively evaluate and comprehensively analysis the performance of ChatGPT on three types of national medical examinations in China, including National Medical Licensing Examination (NMLE), National Pharmacist Licensing Examination (NPLE), and National Nurse Licensing Examination (NNLE).

Authors

  • Hui Zong
    Research Center for Translational Medicine, Shanghai East Hospital, School of Life Sciences and Technology, Tongji University, Shanghai, China.
  • Jiakun Li
    Department of Urology and Institutes for Systems Genetics, Frontiers Science Center for Disease-related Molecular Network, West China Hospital, Sichuan University, No. 37, Guoxue Alley, Chengdu, 610212, China.
  • Erman Wu
    Department of Urology and Institutes for Systems Genetics, Frontiers Science Center for Disease-related Molecular Network, West China Hospital, Sichuan University, No. 37, Guoxue Alley, Chengdu, 610212, China.
  • Rongrong Wu
    Institutes for Systems Genetics, Frontiers Science Center for Disease-related Molecular Network, West China Hospital, Sichuan University, Chengdu 610212, Sichuan, China; Center for Systems Biology, Soochow University, Suzhou 215006, Jiangsu, China.
  • Junyu Lu
    Department of Urology and Institutes for Systems Genetics, Frontiers Science Center for Disease-related Molecular Network, West China Hospital, Sichuan University, No. 37, Guoxue Alley, Chengdu, 610212, China.
  • Bairong Shen
    Institute of Systems Genetics, Department of Critical Care Medicine, Frontiers Science Center for Disease-related Molecular Network, State Key Laboratory of Biotherapy and Cancer Center, West China Hospital, Sichuan University, Chengdu 610000, China.

Keywords

External Resources

Popular Topics
Recent Journals