Comparison between multimodal foundation models and radiologists for the diagnosis of challenging neuroradiology cases with text and images.

Journal: Diagnostic and interventional imaging
Published Date:

Abstract

PURPOSE: The purpose of this study was to compare the ability of two multimodal models (GPT-4o and Gemini 1.5 Pro) with that of radiologists to generate differential diagnoses from textual context alone, key images alone, or a combination of both using complex neuroradiology cases.

Authors

  • Bastien Le Guellec
    Department of Neuroradiology, CHU Lille, Salengro Hospital, Lille 59000, France; Université Lille, INSERM, CHU Lille, Institut Pasteur de Lille, U1167-RID-AGE - Facteurs de Risque et Déterminants Moléculaires des Maladies Liées au Vieillissement, Lille 59000, France; INSERM, U1172-LilNCog-Lille Neuroscience & Cognition, Université de Lille, Lille 59000, France. Electronic address: bastien.leguellec@chu-lille.fr.
  • Cyril Bruge
    Department of Radiology, Lens Hospital, Lens 62300, France.
  • Najib Chalhoub
    Department of Neuroradiology, CHU Lille, Salengro Hospital, Lille 59000, France.
  • Victor Chaton
    Department of Neuroradiology, Saint Philibert Hospital, Lille 59160, France.
  • Edouard De Sousa
    Department of Neuroradiology, CHU Lille, Salengro Hospital, Lille 59000, France.
  • Yann Gaillandre
    Department of Neuroradiology, CHU Lille, Salengro Hospital, Lille 59000, France.
  • Riyad Hanafi
    Department of Neuroradiology, CHU Lille, Salengro Hospital, Lille 59000, France.
  • Matthieu Masy
    Department of Neuroradiology, Valenciennes Hospital, Valenciennes 59300, France.
  • Quentin Vannod-Michel
    Department of Neuroradiology, CHU Lille, Salengro Hospital, Lille 59000, France.
  • Aghiles Hamroun
    Université Lille, INSERM, CHU Lille, Institut Pasteur de Lille, U1167-RID-AGE - Facteurs de Risque et Déterminants Moléculaires des Maladies Liées au Vieillissement, Lille 59000, France; Public Health - Epidemiology Department, CHU Lille, Maison Régionale de la Recherche Clinique, Lille 59000, France.
  • Grégory Kuchcinski
    Department of Neuroradiology, CHU Lille, Salengro Hospital, Lille 59000, France; INSERM, U1172-LilNCog-Lille Neuroscience & Cognition, Université de Lille, Lille 59000, France.

Keywords

No keywords available for this article.