The performance of ChatGPT and ERNIE Bot in surgical resident examinations.

Journal: International journal of medical informatics
Published Date:

Abstract

STUDY PURPOSE: To assess the application of these two large language models (LLMs) for surgical resident examinations and to compare the performance of these LLMs with that of human residents.

Authors

  • Siyin Guo
    Division of Thyroid Surgery, Department of General Surgery, West China Hospital, Sichuan University, Chengdu, Sichuan 610041, China; The Laboratory of Thyroid and Parathyroid Disease, Frontiers Science Center for Disease-related Molecular Network, West China Hospital, Sichuan University, Chengdu, China. Electronic address: guosiyin2000@163.com.
  • Genpeng Li
    Division of Thyroid Surgery, Department of General Surgery, West China Hospital, Sichuan University, Chengdu, Sichuan 610041, China; The Laboratory of Thyroid and Parathyroid Disease, Frontiers Science Center for Disease-related Molecular Network, West China Hospital, Sichuan University, Chengdu, China. Electronic address: ligenpeng@wchscu.cn.
  • Wei Du
    Department of Respiratory and Critical Care Medicine, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 200025, China.
  • Fangzhi Situ
    Department of General Surgery, West China Hospital, Sichuan University, Chengdu, Sichuan 610041, China. Electronic address: 312616385@qq.com.
  • Zhihui Li
    Department of Radiology, Changhai Hospital, No.168 Changhai Road, Shanghai, 200433, China.
  • Jianyong Lei
    Division of Thyroid Surgery, Department of General Surgery, West China Hospital, Sichuan University, Chengdu, Sichuan 610041, China; The Laboratory of Thyroid and Parathyroid Disease, Frontiers Science Center for Disease-related Molecular Network, West China Hospital, Sichuan University, Chengdu, China. Electronic address: leijianyong@scu.edu.cn.