Machine learning derived retinal pigment score from ophthalmic imaging shows ethnicity is not biology.

Journal: Nature communications
PMID:

Abstract

Few metrics exist to describe phenotypic diversity within ophthalmic imaging datasets, with researchers often using ethnicity as a surrogate marker for biological variability. We derived a continuous, measured metric, the retinal pigment score (RPS), that quantifies the degree of pigmentation from a colour fundus photograph of the eye. RPS was validated using two large epidemiological studies with demographic and genetic data (UK Biobank and EPIC-Norfolk Study) and reproduced in a Tanzanian, an Australian, and a Chinese dataset. A genome-wide association study (GWAS) of RPS from UK Biobank identified 20 loci with known associations with skin, iris and hair pigmentation, of which eight were replicated in the EPIC-Norfolk cohort. There was a strong association between RPS and ethnicity, however, there was substantial overlap between each ethnicity and the respective distributions of RPS scores. RPS decouples traditional demographic variables from clinical imaging characteristics. RPS may serve as a useful metric to quantify the diversity of the training, validation, and testing datasets used in the development of AI algorithms to ensure adequate inclusion and explainability of the model performance, critical in evaluating all currently deployed AI models. The code to derive RPS is publicly available at: https://github.com/uw-biomedical-ml/retinal-pigmentation-score .

Authors

  • Anand E Rajesh
    Department of Ophthalmology, University of Washington, Seattle, Washington; The Roger and Angie Karalis Johnson Retina Center, Seattle, Washington.
  • Abraham Olvera-Barrios
    Medical Retina, Moorfields Eye Hospital NHS Foundation Trust, London, UK a.olvera@nhs.net.
  • Alasdair N Warwick
    Moorfields Eye Hospital NHS Foundation Trust, London; Institute of Cardiovascular Science, University College London, London.
  • Yue Wu
    Key Laboratory of Luminescence and Real-Time Analytical Chemistry (Ministry of Education), College of Pharmaceutical Sciences, Southwest University, Chongqing 400716, China.
  • Kelsey V Stuart
    NIHR Biomedical Research Centre, Moorfields Eye Hospital NHS Foundation Trust & University College London Institute of Ophthalmology, London, UK.
  • Mahantesh I Biradar
    NIHR Biomedical Research Centre, Moorfields Eye Hospital NHS Foundation Trust & University College London Institute of Ophthalmology, London, UK.
  • Chuin Ying Ung
    Guy's and St Thomas' NHS Foundation Trust, London, UK.
  • Anthony P Khawaja
    NIHR Biomedical Research Centre at Moorfields Eye Hospital and UCL Institute of Ophthalmology, London EC1V 9EL, UK; MRC Epidemiology Unit, University of Cambridge, Cambridge CB2 0SL, UK.
  • Robert Luben
    NIHR Biomedical Research Centre, Moorfields Eye Hospital NHS Foundation Trust & University College London Institute of Ophthalmology, London, UK.
  • Paul J Foster
    UCL Institute of Ophthalmology, Faculty of Brain Science, University College London, 11-43 Bath Street, London EC1V 9EL, UK.
  • Charles R Cleland
    International Centre for Eye Health, London School of Hygiene and Tropical Medicine, University of London, London, UK.
  • William U Makupa
    Eye Department, Kilimanjaro Christian Medical Centre, Moshi, United Republic of Tanzania.
  • Alastair K Denniston
    Centre for Patient Reported Outcomes Research Institute of Applied Health Research University of Birmingham Birmingham Reino Unido Centre for Patient Reported Outcomes Research, Institute of Applied Health Research, University of Birmingham, Birmingham, Reino Unido.
  • Matthew J Burton
    International Centre for Eye Health, Department of Clinical Research, London School of Hygiene & Tropical Medicine, London, UK.
  • Andrew Bastawrous
    The International Centre for Eye Health (ICEH), London School of Hygiene and Tropical Medicine, London, United Kingdom.
  • Pearse A Keane
    National Institute for Health Research Biomedical Research Centre for Ophthalmology, Moorfields Eye Hospital NHS Foundation Trust and UCL Institute of Ophthalmology, London, UK.
  • Mark A Chia
    NIHR Biomedical Research Centre for Ophthalmology, Moorfields Eye Hospital NHS Foundation Trust and UCL Institute of Ophthalmology, London, UK.
  • Angus W Turner
    Lions Outback Vision, Lions Eye Institute, Nedlands, Western Australia, Australia; University of Western Australia, Perth, Western Australia, Australia.
  • Cecilia S Lee
    Department of Ophthalmology, University of Washington, Seattle, Washington, USA.
  • Adnan Tufail
    London, United Kingdom. Electronic address: Adnan.Tufail@moorfields.nhs.uk.
  • Aaron Y Lee
    Department of Ophthalmology, University of Washington, Seattle, Washington.
  • Catherine Egan
    NIHR Biomedical Research Centre at Moorfields Eye Hospital and UCL Institute of Ophthalmology, London, UK.