Harnessing advanced large language models in otolaryngology board examinations: an investigation using python and application programming interfaces.

Journal: European archives of oto-rhino-laryngology : official journal of the European Federation of Oto-Rhino-Laryngological Societies (EUFOS) : affiliated with the German Society for Oto-Rhino-Laryngology - Head and Neck Surgery
Published Date: Apr 25, 2025

Abstract

PURPOSE: This study aimed to explore the capabilities of advanced large language models (LLMs), including OpenAI's GPT-4 variants, Google's Gemini series, and Anthropic's Claude series, in addressing highly specialized otolaryngology board examination questions. Additionally, the study included a longitudinal assessment of GPT-3.5 Turbo, which was evaluated using the same set of questions one year ago to identify changes in its performance over time.

Authors

  • Cosima C Hoch
    Department of Otolaryngology, Head and Neck Surgery, TUM School of Medicine and Health, Technical University of Munich (TUM), Ismaningerstrasse 22, 81675, Munich, Germany. cosima.chiara.hoch@tum.de.
  • Paul F Funk
    Department of Otorhinolaryngology, Jena University Hospital, Friedrich-Schiller-University Jena, 07747, Jena, Germany.
  • Orlando Guntinas-Lichius
    Department of Otorhinolaryngology, Jena University Hospital, Friedrich-Schiller-University Jena, 07747, Jena, Germany.
  • Gerd Fabian Volk
    Department of Otorhinolaryngology, Jena University Hospital, Friedrich-Schiller-University Jena, 07747, Jena, Germany.
  • Jan-Christoffer Lüers
    Department of Otorhinolaryngology, Head and Neck Surgery, Medical Faculty, University of Cologne, 50937, Cologne, Germany.
  • Timon Hussain
    Department of Otolaryngology, Head and Neck Surgery, TUM School of Medicine and Health, Technical University of Munich (TUM), Ismaningerstrasse 22, 81675, Munich, Germany.
  • Markus Wirth
    Department of Otolaryngology, Head and Neck Surgery, TUM School of Medicine and Health, Technical University of Munich (TUM), Ismaningerstrasse 22, 81675, Munich, Germany.
  • Benedikt Schmidl
    Department of Otolaryngology, Head and Neck Surgery, TUM School of Medicine and Health, Technical University of Munich (TUM), Ismaningerstrasse 22, 81675, Munich, Germany.
  • Barbara Wollenberg
    Department of Otolaryngology, Head and Neck Surgery, TUM School of Medicine and Health, Technical University of Munich (TUM), Ismaningerstrasse 22, 81675, Munich, Germany.
  • Michael Alfertshofer
    Division of Hand, Plastic and Aesthetic Surgery, Ludwig-Maximilians University Munich, Munich, Germany.

Keywords

No keywords available for this article.

External Resources

Popular Topics
Recent Journals