Comparison of ChatGPT plus (version 4.0) and pretrained AI model (Orthopod) on orthopaedic in-training exam (OITE).

Journal: The surgeon : journal of the Royal Colleges of Surgeons of Edinburgh and Ireland
Published Date: Apr 22, 2025

Abstract

INTRODUCTION: Recent advancements in large language model (LLM) artificial intelligence (AI) systems, like ChatGPT, have showcased ability in answering standardized examination questions, but their performance is variable. The goal of this study was to compare the performance of standard ChatGPT-4 with a custom-trained ChatGPT model taking the Orthopaedic Surgery In-Training Examination (OITE).

Authors

  • Matthew L Magruder
    Maimonides Medical Center, Department of Orthopaedic Surgery, Brooklyn, New York.
  • Michael Miskiewicz
    Renaissance School of Medicine at Stony Brook University Medical Center, Stony Brook, NY, USA. Electronic address: Michael.miskiewicz@stonybrookmedicine.edu.
  • Ariel N Rodriguez
    Department of Orthopaedic Surgery, Maimonides Medical Center, Brooklyn, NY, USA.
  • Mitchell Ng
    Department of Orthopaedic Surgery, Maimonides Medical Center, Brooklyn, NY, USA.
  • Amr Abdelgawad
    Department of Orthopaedic Surgery, Texas Tech University Health Sciences Center, El Paso, Texas. Address correspondence to: Amr Abdelgawad, MD, Department of Orthopaedic Surgery, Texas Tech University Health Sciences Center, 4800 Alberta Avenue, El Paso, TX 79905; e-mail: amratef@doctor.com.

Keywords

External Resources

Popular Topics
Recent Journals