Evaluating ChatGPT's effectiveness and tendencies in Japanese internal medicine.

Journal: Journal of evaluation in clinical practice
PMID:

Abstract

INTRODUCTION: ChatGPT, a large-scale language model, is a notable example of AI's potential in health care. However, its effectiveness in clinical settings, especially when compared to human physicians, is not fully understood. This study evaluates ChatGPT's capabilities and limitations in answering questions for Japanese internal medicine specialists, aiming to clarify its accuracy and tendencies in both correct and incorrect responses.

Authors

  • Yudai Kaneda
    School of Medicine, Hokkaido University, Sapporo 060-8638, Japan.
  • Akari Tayuinosho
    School of Medicine, Nagoya University, Aichi, Japan.
  • Rika Tomoyose
    School of Medicine, Hokkaido University, Hokkaido, Japan.
  • Morihito Takita
    Department of Internal Medicine, Accessible Rail Medical Services Tetsuikai, Navitas Clinic Tachikawa, Tachikawa, Japan.
  • Tamae Hamaki
    Department of Internal Medicine, Accessible Rail Medical Services Tetsuikai, Navitas Clinic Shinjuku, Tokyo, Japan.
  • Tetsuya Tanimoto
    Navitas Clinic Kawasaki, Ekimaehonmachi 26-1, Kawasakiku, Kawasakishi, Kanagawa, 2100007, Japan. Electronic address: ttanimot@gmail.com.
  • Akihiko Ozaki
    MNES Inc, Hiroshima.