Performance of open-source and proprietary large language models in generating patient-friendly radiology chest CT reports.

Journal: Clinical imaging
Published Date:

Abstract

RATIONALE AND OBJECTIVES: Large Language Models (LLMs) show promise for generating patient-friendly radiology reports, but the performance of open-source versus proprietary LLMs needs assessment. To compare open-source and proprietary LLMs in generating patient-friendly radiology reports from chest CTs using quantitative readability metrics and qualitative assessments by radiologists.

Authors

  • Philipp Prucker
    School of Medicine and Health, Department of Diagnostic and Interventional Radiology, Klinikum rechts der Isar, TUM University Hospital, Technical University of Munich, Munich, Germany.
  • Felix Busch
    Institute for Diagnostic and Interventional Radiology, TUM School of Medicine and Health, TUM University Hospital Rechts der Isar, Technical University of Munich, Munich, Germany.
  • Felix Dorfner
    Department of Radiology, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Charitéplatz 1, 10117 Berlin, Germany (F.A.M., L.D., F.D., L.R., K.D., H.H., L.X., F.B.); Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, 149 13th St, Charlestown, MA 02129 (F.D.).
  • Christian J Mertens
    Department of Diagnostic and Interventional Radiology, School of Medicine and Health, Klinikum rechts der Isar, TUM University Hospital, Technical University of Munich, Munich, Germany.
  • Nadine Bayerl
    Friedrich-Alexander-Universität Erlangen-Nürnberg, Institute of Radiology, University Hospital Erlangen, Maximiliansplatz 3, 91054 Erlangen, Germany. Electronic address: nadine.bayerl@fau.de.
  • Marcus R Makowski
    School of Medicine and Health, Department of Diagnostic and Interventional Radiology, Klinikum rechts der Isar, TUM University Hospital, Technical University of Munich, Munich, Germany.
  • Keno K Bressem
    School of Medicine and Health, Institute for Cardiovascular Radiology and Nuclear Medicine, German Heart Center Munich, TUM University Hospital, Technical University of Munich, Munich, Germany.
  • Lisa C Adams
    School of Medicine and Health, Department of Diagnostic and Interventional Radiology, Klinikum rechts der Isar, TUM University Hospital, Technical University of Munich, Munich, Germany.