Generative pretrained transformer-4, an artificial intelligence text predictive model, has a high capability for passing novel written radiology exam questions.

Journal: International journal of computer assisted radiology and surgery
Published Date:

Abstract

PURPOSE: AI-image interpretation, through convolutional neural networks, shows increasing capability within radiology. These models have achieved impressive performance in specific tasks within controlled settings, but possess inherent limitations, such as the inability to consider clinical context. We assess the ability of large language models (LLMs) within the context of radiology specialty exams to determine whether they can evaluate relevant clinical information.

Authors

  • Avnish Sood
    School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK.
  • Nina Mansoor
    Department of Neuroradiology, Kings College Hospital, Denmark Hill, London, SE59RS, UK.
  • Caroline Memmi
    Imperial College London, Exhibition Road, London, SW7 2AZ, UK.
  • Magnus Lynch
    King's College London Centre for Stem Cells and Regenerative Medicine, Guy's Hospital, Great Maze Pond, London, UK.
  • Jeremy Lynch
    Department of Neuroradiology, Ruskin Wing, King's College Hospital NHS Foundation Trust, London, SE5 9RS, UK.