Performance evaluation of large language models for the national nursing examination in Japan.

Journal: Digital health
Published Date:

Abstract

OBJECTIVES: Large language models (LLMs) are increasingly used in healthcare, with the potential for various applications. However, the performance of different LLMs on nursing license exams and their tendencies to make errors remain unclear. This study aimed to evaluate the accuracy of LLMs on basic nursing knowledge and identify trends in incorrect answers.

Authors

  • Tomoki Kuribara
    School of Nursing, Sapporo City University, Sapporo, Japan.
  • Kengo Hirayama
    School of Nursing, Sapporo City University, Sapporo, Japan.
  • Kenji Hirata
    Department of Diagnostic Imaging, Faculty of Medicine and Graduate School of Medicine, Hokkaido University, Sapporo, Japan.

Keywords

No keywords available for this article.