The role of artificial intelligence in medical education: an evaluation of Large Language Models (LLMs) on the Turkish Medical Specialty Training Entrance Exam.

Journal: BMC medical education
PMID: 40281510

Abstract

OBJECTIVE: To evaluate the performance of advanced large language models (LLMs)-OpenAI-ChatGPT 4, Google AI-Gemini 1.5 Pro, Cohere-Command R + and Meta AI-Llama 3 70B on questions from the Turkish Medical Specialty Training Entrance Exam (2021, 1st semester) and analyze their answers for user interpretability in languages other than English.

Authors

  • Murat Koçak
    Faculty of Medicine, Department of Medical Informatics, Baskent University, Ankara, Turkey. muratkocak25@gmail.com.
  • Ali Kemal Oğuz
    Department of Internal Medicine, Faculty of Medicine, Baskent University, Ankara, Turkey.
  • Zafer Akçalı
    Faculty of Medicine, Department of Medical Informatics, Baskent University, Ankara, Turkey.

Keywords

External Resources

Popular Topics
Recent Journals