GPT-4/4V's performance on the Japanese National Medical Licensing Examination.

Journal: Medical teacher
Published Date:

Abstract

BACKGROUND: Recent advances in Artificial Intelligence (AI) are changing the medical world, and AI will likely replace many of the actions performed by medical professionals. The overall clinical ability of the AI has been evaluated by its ability to answer a text-based national medical examination. This study uniquely assesses the performance of Open AI's ChatGPT against all Japanese National Medical Licensing Examination (NMLE), including images, illustrations, and pictures.

Authors

  • Tomoki Kawahara
    Department of Clinical Information Applied Sciences, Tokyo Medical and Dental University, Tokyo, Japan.
  • Yuki Sumi
    Clinical Information Applied Sciences, Tokyo Medical and Dental University, Tokyo, 113-8519, Japan. sumi-alg@umin.ac.jp.