Clinically applicable deep learning for diagnosis and referral in retinal disease.

Journal: Nature medicine
Published Date:

Abstract

The volume and complexity of diagnostic imaging is increasing at a pace faster than the availability of human expertise to interpret it. Artificial intelligence has shown great promise in classifying two-dimensional photographs of some common diseases and typically relies on databases of millions of annotated images. Until now, the challenge of reaching the performance of expert clinicians in a real-world clinical pathway with three-dimensional diagnostic scans has remained unsolved. Here, we apply a novel deep learning architecture to a clinically heterogeneous set of three-dimensional optical coherence tomography scans from patients referred to a major eye hospital. We demonstrate performance in making a referral recommendation that reaches or exceeds that of experts on a range of sight-threatening retinal diseases after training on only 14,884 scans. Moreover, we demonstrate that the tissue segmentations produced by our architecture act as a device-independent representation; referral accuracy is maintained when using tissue segmentations from a different type of device. Our work removes previous barriers to wider clinical use without prohibitive training data requirements across multiple pathologies in a real-world setting.

Authors

  • Jeffrey De Fauw
    DeepMind, London, EC4A 3TW, UK.
  • Joseph R Ledsam
    DeepMind, London, UK.
  • Bernardino Romera-Paredes
    DeepMind, London, UK.
  • Stanislav Nikolov
    DeepMind, London, UK.
  • Nenad Tomasev
    DeepMind, London, EC4A 3TW, UK.
  • Sam Blackwell
    DeepMind, London, UK.
  • Harry Askham
    DeepMind, London, UK.
  • Xavier Glorot
    DeepMind, London, UK.
  • Brendan O'Donoghue
    DeepMind, London, UK.
  • Daniel Visentin
    DeepMind, London, EC4A 3TW, UK.
  • George van den Driessche
    DeepMind, London, EC4A 3TW, UK.
  • Balaji Lakshminarayanan
    DeepMind, London, UK.
  • Clemens Meyer
    DeepMind, London, UK.
  • Faith Mackinder
    DeepMind, London, UK.
  • Simon Bouton
    DeepMind, London, UK.
  • Kareem Ayoub
    DeepMind, London, UK.
  • Reena Chopra
    NIHR Biomedical Research Centre for Ophthalmology, Moorfields Eye Hospital NHS Foundation Trust and UCL Institute of Ophthalmology, London, United Kingdom.
  • Dominic King
    DeepMind, London, UK.
  • Alan Karthikesalingam
    Department of Outcomes Research, St George's Vascular Institute, London, SW17 0QT, United Kingdom.
  • Cian O Hughes
    DeepMind, London, EC4A 3TW, UK.
  • Rosalind Raine
    Department of Applied Heath Research, University College London, London, WC1E 7HB, UK.
  • Julian Hughes
    NIHR Biomedical Research Centre at Moorfields Eye Hospital and UCL Institute of Ophthalmology, London, UK.
  • Dawn A Sim
    National Institutes of Health Research Biomedical Research Centre Biomedical Centre, Moorfields Eye Hospital NHS Foundation Trust and UCL Institute of Ophthalmology, London, UK.
  • Catherine Egan
    NIHR Biomedical Research Centre at Moorfields Eye Hospital and UCL Institute of Ophthalmology, London, UK.
  • Adnan Tufail
    London, United Kingdom. Electronic address: Adnan.Tufail@moorfields.nhs.uk.
  • Hugh Montgomery
    Institute of Sport, Exercise and Health, London, W1T 7HA, UK.
  • Demis Hassabis
    Google DeepMind, 5 New Street Square, London EC4A 3TW, UK.
  • Geraint Rees
    Institute of Neurology, University College London, London, WC1N 3BG, UK.
  • Trevor Back
    DeepMind, London, EC4A 3TW, UK.
  • Peng T Khaw
    NIHR Biomedical Research Centre at Moorfields Eye Hospital and UCL Institute of Ophthalmology, London, UK.
  • Mustafa Suleyman
    DeepMind, London, UK.
  • Julien Cornebise
    DeepMind, London, EC4A 3TW, UK.
  • Pearse A Keane
    National Institute for Health Research Biomedical Research Centre for Ophthalmology, Moorfields Eye Hospital NHS Foundation Trust and UCL Institute of Ophthalmology, London, UK.
  • Olaf Ronneberger
    DeepMind, London, EC4A 3TW, UK.