Evaluating AI proficiency in nuclear cardiology: Large language models take on the board preparation exam.

Journal: Journal of nuclear cardiology : official publication of the American Society of Nuclear Cardiology
PMID: 39617127

Abstract

BACKGROUND: Previous studies evaluated the ability of large language models (LLMs) in medical disciplines; however, few have focused on image analysis, and none specifically on cardiovascular imaging or nuclear cardiology. This study assesses four LLMs-GPT-4, GPT-4 Turbo, GPT-4omni (GPT-4o) (Open AI), and Gemini (Google Inc.)-in responding to questions from the 2023 American Society of Nuclear Cardiology Board Preparation Exam, reflecting the scope of the Certification Board of Nuclear Cardiology (CBNC) examination.

Authors

  • Valerie Builoff
    Department of Medicine (Division of Artificial Intelligence in Medicine), Imaging, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California, USA.
  • Aakash Shanbhag
    Division of Artificial Intelligence, Department of Medicine, Cedars-Sinai Medical Center, Los Angeles, CA, USA.
  • Robert Jh Miller
    Departments of Imaging, Medicine, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles CA; Department of Cardiac Sciences, University of Calgary, Calgary, AB, Canada.
  • Damini Dey
    Departments of Imaging and Medicine, and Cedars-Sinai Heart Institute, Cedars-Sinai Medical Center, 8700 Beverly Blvd, Taper A238, Los Angeles, CA, 90048, USA.
  • Joanna X Liang
    Division of Nuclear Medicine, Department of Imaging, and Departments of Medicine and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California.
  • Kathleen Flood
    American Society of Nuclear Cardiology, Fairfax, VA, USA.
  • Jamieson M Bourque
    Division of Cardiovascular Medicine and Radiology, University of Virginia Health System, Charlottesville, VA, USA.
  • Panithaya Chareonthaitawee
    Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN.
  • Lawrence M Phillips
    Leon H. Charney Division of Cardiology, Department of Medicine, NYU Grossman School of Medicine, New York, NY, USA.
  • Piotr J Slomka
    Department of Imaging, Medicine, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California Piotr.Slomka@cshs.org.

Keywords

External Resources

Popular Topics
Recent Journals