The Advanced Reasoning Capabilities of Large Language Models for Detecting Contraindicated Options in Medical Exams.

Journal: JMIR medical informatics
Published Date: May 12, 2025

Abstract

Enhancing clinical reasoning and reducing diagnostic errors are essential in medical practice; OpenAI-o1, with advanced reasoning capabilities, performed better than GPT-4 on 15 Japanese National Medical Licensing Examination questions (accuracy: 100% vs 80%; contraindicated option detection: 87% vs 73%), though findings are preliminary due to the small sample size.

Authors

  • Yuichiro Yano
    Department of General Medicine, Juntendo University Faculty of Medicine, 2-1-1, Hongo, Bunkyo-Ku, Tokyo, 113-8421, Japan, 81 3-3813-3111.
  • Mizuki Ohashi
    Department of General Medicine, Juntendo University Faculty of Medicine, 2-1-1, Hongo, Bunkyo-Ku, Tokyo, 113-8421, Japan, 81 3-3813-3111.
  • Taiju Miyagami
    Department of General Medicine, Juntendo University Faculty of Medicine, 2-1-1, Hongo, Bunkyo-Ku, Tokyo, 113-8421, Japan, 81 3-3813-3111.
  • Hirotake Mori
    Department of General Medicine, Juntendo University Faculty of Medicine, 2-1-1, Hongo, Bunkyo-Ku, Tokyo, 113-8421, Japan, 81 3-3813-3111.
  • Yuji Nishizaki
    Division of Medical Education, Juntendo University School of Medicine, Tokyo, Japan.
  • Hiroyuki Daida
    Department of Radiology Technology, Juntendo University Faculty of Health Science, Tokyo, Japan.
  • Toshio Naito
    Department of General Medicine, Juntendo University Faculty of Medicine, 2-1-1, Hongo, Bunkyo-Ku, Tokyo, 113-8421, Japan, 81 3-3813-3111.

Keywords

No keywords available for this article.

External Resources

Popular Topics
Recent Journals