Performance of ChatGPT in medical licensing examinations in countries worldwide: A systematic review and meta-analysis protocol.

Journal: PloS one
PMID: 39466750

Abstract

INTRODUCTION: In November 2022, the online artificial intelligence (AI) chatbot ChatGPT was released to the public, and swiftly garnered global attention because of its ability to provide detailed answers to complex queries. In medical field, ChatGPT has shown great potential to be used in medical education and has excelled in many English-language medical licensing examinations. However, due to the variability of medical licensing examinations in different countries, and ChatGPT's particular proficiency in English, the previous literatures showed that ChatGPT is unable to pass medical licensing examinations from non-English-speaking countries or those not administered in English. To the best of our knowledge, this is the first study to review whether ChatGPT can demonstrate consistent accuracy across diverse medical licensing examinations and be used in medical education across countries.

Authors

  • Mingxin Liu
    College of Electronics and Information Engineering, Guangdong Ocean University, Zhanjiang, China.
  • Tsuyoshi Okuhara
    University Hospital Medical Information Network (UMIN) Center, The University of Tokyo Hospital, 7-3-1, Hongo, Bunkyo-ku, Tokyo 113-8655, Japan.
  • Xinyi Chang
    Department of Industrial Engineering and Economics, School of Engineering, Tokyo Institute of Technology, Tokyo, Japan.
  • Hiroko Okada
    University Hospital Medical Information Network (UMIN) Center, The University of Tokyo Hospital, 7-3-1, Hongo, Bunkyo-ku, Tokyo 113-8655, Japan.
  • Takahiro Kiuchi
    University Hospital Medical Information Network (UMIN) Center, The University of Tokyo Hospital, 7-3-1, Hongo, Bunkyo-ku, Tokyo 113-8655, Japan.

Keywords

External Resources

Popular Topics
Recent Journals