Interpretable longitudinal glaucoma visual field estimation deep learning system from fundus images and clinical narratives.

Journal: NPJ digital medicine
Published Date:

Abstract

Glaucoma is a globally prevalent disease that leads irreversible blindness. The visual field (VF) examination is important but time-consuming for visual function evaluation with high requirement of cooperation and reliability of patients. While color fundus photographs (CFPs) are easy to access. Here, we proposed a multi-modal longitudinal estimation deep learning (MLEDL) system, capable of predicting present and future VFs from CFPs and clinical text. This model was developed on 1598 records in cross-sectional and 3278 records in longitudinal dataset, with 446 external testing records. The pointwise mean absolute error across five models ranged from 3.098 to 4.131 dB. Heatmaps demonstrated the spatial relationship between fundus damage and vision loss. VF grading methods were employed for verifying the clinical reliability. Consequently, our MLEDL facilitates VF prediction by CFPs and clinical narratives, offering potential as function assessment tool over the long-duration course of glaucoma and thereby improving clinical practice efficiency.

Authors

  • Xiaoling Huang
    Department of Ophthalmology, The Second Affiliated Hospital of Zhejiang University, College of Medicine, Hangzhou, 310009, China.
  • Xiangyin Kong
    Institute of Health Sciences, Shanghai Institutes for Biological Sciences, Chinese Academy of Sciences, Shanghai, People's Republic of China.
  • Yan Yan
    Department of Biomedical Engineering, Wayne State University, Detroit, Michigan, USA.
  • Zhiyuan Gao
    Department of Ophthalmology, The Second Affiliated Hospital of Zhejiang University, College of Medicine, Hangzhou, Zhejiang, China.
  • Zihan Li
    MicroPort(Shanghai) MedBot Co. Ltd, Shanghai, 200031.
  • Chun Zhang
    Department of Ophthalmology, Peking University Third Hospital, Beijing, China.
  • Kai Jin
    Eye Center, The Second Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, China.
  • Juan Ye
    Eye Center, The Second Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, China.

Keywords

No keywords available for this article.