Should my recommendation letter be written by artificial intelligence?

Journal: Canadian journal of surgery. Journal canadien de chirurgie
PMID: 38843943

Abstract

Letters of recommendation are increasingly important for the residency match. We assessed whether an artificial intelligence (AI) tool could help in writing letters of recommendation by analyzing recommendation letters written by 3 academic staff and AI duplicate versions for 13 applicants. The preferred letters were selected by 3 blinded orthopedic program directors based on a pre-determined set of criteria. The first orthopedic program director selected the AI letter for 31% of applicants, and the 2 remaining program directors selected the AI letter for 38% of applicants, with the staff-written versions selected more often by all of the program directors ( < 0.05). The first program director recognized only 15% of the AI-written letters, the second was able to identify 92%, and the third director identified 77% of AI-written letters ( < 0.05).

Authors

  • Jad Mansour
    From the Division of Orthopaedic Surgery and Sports Medicine, McGill University Health Centre, Montréal, Que. (Mansour, Burman, Bernstein, Martineau); the Department of Orthopedic Surgery, Hôpital du Sacré-Coeur de Montréal, Canada; Université de Montréal, Montréal, Que. (Sandman); the Department of Orthopedic Surgery, Lebanese American University Medical Center - Rizk Hospital, Achrafieh, Beirut, Lebanon (Yammine); the Department of Orthopedic Surgery, Brown University, Providence, RI, USA (Daher) Jad.mansour09@gmail.com.
  • Mark Burman
    From the Division of Orthopaedic Surgery and Sports Medicine, McGill University Health Centre, Montréal, Que. (Mansour, Burman, Bernstein, Martineau); the Department of Orthopedic Surgery, Hôpital du Sacré-Coeur de Montréal, Canada; Université de Montréal, Montréal, Que. (Sandman); the Department of Orthopedic Surgery, Lebanese American University Medical Center - Rizk Hospital, Achrafieh, Beirut, Lebanon (Yammine); the Department of Orthopedic Surgery, Brown University, Providence, RI, USA (Daher).
  • Mitchell Bernstein
    From the Division of Orthopaedic Surgery and Sports Medicine, McGill University Health Centre, Montréal, Que. (Mansour, Burman, Bernstein, Martineau); the Department of Orthopedic Surgery, Hôpital du Sacré-Coeur de Montréal, Canada; Université de Montréal, Montréal, Que. (Sandman); the Department of Orthopedic Surgery, Lebanese American University Medical Center - Rizk Hospital, Achrafieh, Beirut, Lebanon (Yammine); the Department of Orthopedic Surgery, Brown University, Providence, RI, USA (Daher).
  • Emilie Sandman
    From the Division of Orthopaedic Surgery and Sports Medicine, McGill University Health Centre, Montréal, Que. (Mansour, Burman, Bernstein, Martineau); the Department of Orthopedic Surgery, Hôpital du Sacré-Coeur de Montréal, Canada; Université de Montréal, Montréal, Que. (Sandman); the Department of Orthopedic Surgery, Lebanese American University Medical Center - Rizk Hospital, Achrafieh, Beirut, Lebanon (Yammine); the Department of Orthopedic Surgery, Brown University, Providence, RI, USA (Daher).
  • Kaissar Yammine
    From the Division of Orthopaedic Surgery and Sports Medicine, McGill University Health Centre, Montréal, Que. (Mansour, Burman, Bernstein, Martineau); the Department of Orthopedic Surgery, Hôpital du Sacré-Coeur de Montréal, Canada; Université de Montréal, Montréal, Que. (Sandman); the Department of Orthopedic Surgery, Lebanese American University Medical Center - Rizk Hospital, Achrafieh, Beirut, Lebanon (Yammine); the Department of Orthopedic Surgery, Brown University, Providence, RI, USA (Daher).
  • Mohammad Daher
    Department of Orthopedic Surgery, The Warren Alpert Medical School, Brown University, Providence, RI 02912, USA.
  • Paul Andre Martineau
    From the Division of Orthopaedic Surgery and Sports Medicine, McGill University Health Centre, Montréal, Que. (Mansour, Burman, Bernstein, Martineau); the Department of Orthopedic Surgery, Hôpital du Sacré-Coeur de Montréal, Canada; Université de Montréal, Montréal, Que. (Sandman); the Department of Orthopedic Surgery, Lebanese American University Medical Center - Rizk Hospital, Achrafieh, Beirut, Lebanon (Yammine); the Department of Orthopedic Surgery, Brown University, Providence, RI, USA (Daher).

Keywords

External Resources

Popular Topics
Recent Journals