Evaluation of AI Summaries on Interdisciplinary Understanding of Ophthalmology Notes.

Journal: JAMA ophthalmology
Published Date:

Abstract

IMPORTANCE: Specialized ophthalmology terminology limits comprehension for nonophthalmology clinicians and professionals, hindering interdisciplinary communication and patient care. The clinical implementation of large language models (LLMs) into practice has to date been relatively unexplored.

Authors

  • Prashant D Tailor
    Department of Ophthalmology, Mayo Clinic, Rochester, Minnesota.
  • Haley S D'Souza
    Department of Ophthalmology, Mayo Clinic, Rochester, Minnesota.
  • Clara M Castillejo Becerra
    Department of Ophthalmology, Mayo Clinic, Rochester, Minnesota.
  • Heidi M Dahl
    Department of Ophthalmology, Mayo Clinic, Rochester, Minnesota.
  • Neil R Patel
    Department of Allergy & Immunology, ICAHN School of Medicine at Mount Sinai, New York, New York.
  • Tyler M Kaplan
    Department of Ophthalmology, Mayo Clinic, Rochester, Minnesota.
  • Darrell Kohli
    Department of Ophthalmology, Mayo Clinic, Rochester, Minnesota.
  • Erick D Bothun
    Department of Ophthalmology, Mayo Clinic, Rochester, Minnesota.
  • Brian G Mohney
    Department of Ophthalmology, Mayo Clinic, Rochester, Minnesota.
  • Andrea A Tooley
    Department of Ophthalmology, Mayo Clinic, Rochester, Minnesota, USA.
  • Keith H Baratz
    Department of Ophthalmology, Mayo Clinic, Rochester, Minnesota.
  • Raymond Iezzi
    Department of Ophthalmology, Mayo Clinic, Rochester, MN, USA.
  • Andrew J Barkmeier
    Department of Ophthalmology, Mayo Clinic, Rochester, Minnesota.
  • Sophie J Bakri
    Department of Ophthalmology, Mayo Clinic, Rochester, MN, USA.
  • Gavin W Roddy
    Department of Ophthalmology, Mayo Clinic, Rochester, Minnesota.
  • David Hodge
    Department of Quantitative Health Sciences, Mayo Clinic, Jacksonville, Florida.
  • Arthur J Sit
    Department of Ophthalmology, Mayo Clinic, Rochester, Minnesota.
  • Matthew R Starr
    Department of Ophthalmology, Mayo Clinic, Rochester, Minnesota.
  • John J Chen
    From the Singapore National Eye Center (D.M., D.T., S.S., C.-Y.C., T.Y.W.), Singapore Eye Research Institute (D.M., R.P.N., D.T., C.V., S.S., C.-Y.C., T.Y.W.), Duke-NUS Medical School (D.M., R.P.N., D.T., S.S., C.-Y.C., T.Y.W.), Institute of High Performance Computing, Agency for Science, Technology, and Research (J.Z., X.X., Y.L.), and Yong Loo Lin School of Medicine, National University of Singapore (S.S., T.Y.W.) - all in Singapore; Farabi Eye Hospital, Tehran University of Medical Science, Tehran, Iran (M.A.F.); the Department of Ophthalmology, Centro Hospitalar e Universitário de Coimbra, and the Coimbra Institute for Biomedical Imaging and Translational Research, University of Coimbra, Coimbra, Portugal (P.F.); the Department of Ophthalmology, Ramathibodi Hospital, Mahidol University, Bangkok, Thailand (K.V.); the Eye Center, Medical Center, University of Freiburg, Freiburg (W.A.L.), and the Department of Ophthalmology, Ruprecht Karl University of Heidelberg, Mannheim (J.B.J.) - both in Germany; IRCCS Istituto delle Scienze Neurologiche di Bologna, Unità Operativa Complessa Clinica Neurologica, and Dipartimento di Scienze Biomediche e Neuromotorie, Università di Bologna, Bologna, Italy (C.L.M.); the Department of Ophthalmology and Visual Sciences, Chinese University of Hong Kong, Hong Kong (C.Y.C.), and Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangzhou (H.Y.) - both in China; the Department of Ophthalmology, Rigshospitalet, University of Copenhagen, Glostrup, Denmark (S.H.); the Department of Ophthalmology, University Hospital of Grenoble-Alpes, and Grenoble-Alpes University, HP2 Laboratory, INSERM Unité 1042, Grenoble (C.C.), Service d'Ophtalmologie, Unité Rétine-Uvéites-Neuro-Ophtalmologie, Hôpital Pellegrin, Centre Hospitalier Universitaire de Bordeaux, Bordeaux (M.-B.R.), the Department of Ophthalmology, Lille Catholic Hospital, Lille Catholic University, and INSERM Unité 1171, Lille (T.T.H.C.), the Department of Ophthalmology, University Hospital Angers, Angers (P.G.), and Rothschild Foundation Hospital, Paris (C.C.-V.) - all in France; the Department of Clinical Neurosciences, Geneva University Hospital, Geneva (N.S.); the Department of Neurology, SUNY Upstate Medical University, Syracuse, NY (L.J.M.); the American Eye Center, Mandaluyong City, Philippines (R.K.); Moorfields Eye Hospital NHS Foundation Trust and UCL Institute of Ophthalmology, University College London, London (P.Y.-W.-M.), and Cambridge Eye Unit, Addenbrooke's Hospital, Cambridge University Hospitals, and Cambridge Centre for Brain Repair and Medical Research Council Mitochondrial Biology Unit, Department of Clinical Neurosciences, University of Cambridge, Cambridge (P.Y.-W.-M.) - all in the United Kingdom; the Save Sight Institute, Faculty of Health and Medicine, University of Sydney, Sydney (C.L.F.); the Department of Ophthalmology and Neurology, Mayo Clinic, Rochester, MN (J.J.C.); the Department of Neuro-ophthalmology, Sankara Nethralaya, Medical Research Foundation, Chennai, India (S.A.); the Departments of Ophthalmology, Neurology, and Neurosurgery, Johns Hopkins University School of Medicine, Baltimore (N.R.M.); and the Departments of Ophthalmology and Neurology, Emory University School of Medicine, Atlanta (N.J.N., V.B.).