Predicting sex from retinal fundus photographs using automated deep learning.

Journal: Scientific reports
Published Date:

Abstract

Deep learning may transform health care, but model development has largely been dependent on availability of advanced technical expertise. Herein we present the development of a deep learning model by clinicians without coding, which predicts reported sex from retinal fundus photographs. A model was trained on 84,743 retinal fundus photos from the UK Biobank dataset. External validation was performed on 252 fundus photos from a tertiary ophthalmic referral center. For internal validation, the area under the receiver operating characteristic curve (AUROC) of the code free deep learning (CFDL) model was 0.93. Sensitivity, specificity, positive predictive value (PPV) and accuracy (ACC) were 88.8%, 83.6%, 87.3% and 86.5%, and for external validation were 83.9%, 72.2%, 78.2% and 78.6% respectively. Clinicians are currently unaware of distinct retinal feature variations between males and females, highlighting the importance of model explainability for this task. The model performed significantly worse when foveal pathology was present in the external validation dataset, ACC: 69.4%, compared to 85.4% in healthy eyes, suggesting the fovea is a salient region for model performance OR (95% CI): 0.36 (0.19, 0.70) p = 0.0022. Automated machine learning (AutoML) may enable clinician-driven automated discovery of novel insights and disease biomarkers.

Authors

  • Edward Korot
    Moorfields Eye Hospital NHS Foundation Trust, London, UK; Stanford University Byers Eye Institute, Palo Alto, CA, USA.
  • Nikolas Pontikos
    University College London Institute of Ophthalmology, London, UK n.pontikos@ucl.ac.uk.
  • Xiaoxuan Liu
    Birmingham Health Partners Centre for Regulatory Science and Innovation University of Birmingham Birmingham Reino Unido Birmingham Health Partners Centre for Regulatory Science and Innovation, University of Birmingham, Birmingham, Reino Unido.
  • Siegfried K Wagner
    National Institute for Health Research Biomedical Research Centre for Ophthalmology, Moorfields Eye Hospital NHS Foundation Trust and UCL Institute of Ophthalmology, London, UK.
  • Livia Faes
    Moorfields Eye Hospital NHS Foundation Trust, London, UK; Eye Clinic, Cantonal Hospital of Lucerne, Lucerne, Switzerland.
  • Josef Huemer
    Moorfields Eye Hospital, London, United Kingdom.
  • Konstantinos Balaskas
    School of Pharmacy and Optometry, Faculty of Biology, Medicine and Health, The University of Manchester, Manchester, United Kingdom; Manchester Royal Eye Hospital, NHS Central Manchester University Hospitals, Manchester, United Kingdom.
  • Alastair K Denniston
    Centre for Patient Reported Outcomes Research Institute of Applied Health Research University of Birmingham Birmingham Reino Unido Centre for Patient Reported Outcomes Research, Institute of Applied Health Research, University of Birmingham, Birmingham, Reino Unido.
  • Anthony Khawaja
    NIHR Biomedical Research Center at Moorfields Eye Hospital NHS Foundation Trust and UCL Institute of Ophthalmology, London, UK. anthony.khawaja@nhs.net.
  • Pearse A Keane
    National Institute for Health Research Biomedical Research Centre for Ophthalmology, Moorfields Eye Hospital NHS Foundation Trust and UCL Institute of Ophthalmology, London, UK.