Artificial intelligence: Reducing inconsistency in the surgical residency application review process.

Journal: American journal of surgery
PMID: 39079879

Abstract

The incorporation of artificial intelligence (AI) into the general surgery residency recruitment process holds great promise for overcoming limitations inherent to traditional application review methods. This study assesses the consistency of AI, particularly ChatGPT, in evaluating medical student performance evaluation (MSPE) letters in comparison to experienced human reviewers. While the results suggest that ChatGPT demonstrates greater consistency in grading than human reviewers, AI still has its limitations. This underscores the necessity for careful refinement and consideration in its implementation. While AI presents opportunities to enhance residency selection procedures, further research is imperative to fully grasp its capabilities and implications.

Authors

  • Megan Markow
    University of California, Irvine, Department of Surgery, Division of Trauma, Burns and Surgical Critical Care, Orange, CA, USA.
  • Mallory Jebbia
    University of California, Irvine, Department of Surgery, Division of Trauma, Burns and Surgical Critical Care, Orange, CA, USA.
  • Bima J Hasjim
    Department of Surgery, Division of Trauma, Burns and Surgical Critical Care, University of California, Irvine, Orange, USA.
  • Jeffry Nahmias
    Department of Surgery, Division of Trauma, Burns and Surgical Critical Care, University of California, Irvine, Orange, USA.
  • Areg Grigorian
    Department of Surgery, Division of Trauma, Burns and Surgical Critical Care, University of California, Irvine, Orange, USA.
  • Sigrid Burruss
  • Sebastian Schubl
    University of California, Irvine, Department of Surgery, Division of Trauma, Burns and Surgical Critical Care, Orange, CA, USA.
  • Valery Vilchez
    University of California, Irvine, Department of Surgery, Division of Trauma, Burns and Surgical Critical Care, Orange, CA, USA.
  • Kelly Fairbairn
    Department of Surgery, Section of Thoracic Surgery, University of Arizona, 1501 North Campbell Avenue, Room #4302, Tucson, AZ 85724, USA.
  • Anthony Chau
    University of California, Irvine, Department of Surgery, Division of Trauma, Burns and Surgical Critical Care, Orange, CA, USA.
  • Hari Keshava
    University of California, Irvine, Department of Surgery, Division of Trauma, Burns and Surgical Critical Care, Orange, CA, USA.
  • Maki Yamamoto
    University of California, Irvine, Department of Surgery, Division of Trauma, Burns and Surgical Critical Care, Orange, CA, USA.
  • Brian Smith
    University of California, Irvine, Department of Surgery, Division of Trauma, Burns and Surgical Critical Care, Orange, CA, USA.
  • Lourdes Swentek
    Department of Surgery, Division of Acute Care Surgery, Loma Linda University, Loma Linda, USA.

Keywords

External Resources

Popular Topics
Recent Journals