Assessing ChatGPT-4's performance on the US prosthodontic exam: impact of fine-tuning and contextual prompting vs. base knowledge, a cross-sectional study.

Journal: BMC medical education
Published Date: May 23, 2025

Abstract

BACKGROUND: Artificial intelligence (AI), such as ChatGPT-4 from OpenAI, has the potential to transform medical education and assessment. However, its effectiveness in specialized fields like prosthodontics, especially when comparing base to fine-tuned models, remains underexplored. This study evaluates the performance of ChatGPT-4 on the US National Prosthodontic Resident Mock Exam in its base form and after fine-tuning. The aim is to determine whether fine-tuning improves the AI's accuracy in answering specialized questions.

Authors

  • Mahmood Dashti
    Researcher, School of Dentistry, Shahid Beheshti University of Medical Sciences, Tehran, Iran. Electronic address: Dashti.mahmood72@gmail.com.
  • Farshad Khosraviani
    Researcher, UCLA School of Dentistry, California, USA.
  • Tara Azimi
    Post Graduate Student, Orofacial Pain and Disfunction, UCLA School of Dentistry, California, USA.
  • Delband Hefzi
    School of Dentistry, Tehran University of Medical Science, Tehran, Iran.
  • Shohreh Ghasemi
    Adjunct Assistant Professor, Department of Oral and Maxillofacial Surgery, The Dental College of Georgia at Augusta University, Augusta, Ga.
  • Amir Fahimipour
    Discipline of Oral Surgery, Medicine and Diagnostics, Faculty of Medicine and Health, Westmead Hospital, The University of Sydney, Sydney, NSW, 2145, Australia.
  • Niusha Zare
    Department of Operative Dentistry, University of Southern California, Los Angeles, USA.
  • Zohaib Khurshid
    Lecturer, Prosthodontics, Department of Prosthodontics and Dental Implantology, King Faisal University, Al-Ahsa, Saudi Arabia; and Professor, Center of Excellence for Regenerative Dentistry, Department of Anatomy, Faculty of Dentistry, Chulalongkorn University, Bangkok, Thailand.
  • Syed Rashid Habib
    Department of Prosthetic Dental Sciences, College of Dentistry, King Saud University, P. O. Box 60169, King Abdullah Road, 11545, Riyadh, Saudi Arabia. syhabib@ksu.edu.sa.

Keywords

External Resources

Popular Topics
Recent Journals