ChatGPT failed Taiwan's Family Medicine Board Exam.

Journal: Journal of the Chinese Medical Association : JCMA
PMID:

Abstract

BACKGROUND: Chat Generative Pre-trained Transformer (ChatGPT), OpenAI Limited Partnership, San Francisco, CA, USA is an artificial intelligence language model gaining popularity because of its large database and ability to interpret and respond to various queries. Although it has been tested by researchers in different fields, its performance varies depending on the domain. We aimed to further test its ability in the medical field.

Authors

  • Tzu-Ling Weng
    Center for Geriatrics and Gerontology, Taipei Veterans General Hospital, Taipei, Taiwan, ROC.
  • Ying-Mei Wang
    Department of Medical Education and Research, Taipei Veterans General Hospital Hsinchu Branch, Hsinchu, Taiwan, ROC.
  • Samuel Chang
    School of Medicine, Taipei Medical University, Taipei, Taiwan, ROC.
  • Tzeng-Ji Chen
    Department of Family Medicine, Taipei Veterans General Hospital Hsinchu Branch, Hsinchu County, Taiwan, ROC.
  • Shinn-Jang Hwang
    Department of Family Medicine, En Chu Kong Hospital, New Taipei City, Taiwan, ROC.