A combined convolutional and recurrent neural network for enhanced glaucoma detection.

Journal: Scientific reports
Published Date:

Abstract

Glaucoma, a leading cause of blindness, is a multifaceted disease with several patho-physiological features manifesting in single fundus images (e.g., optic nerve cupping) as well as fundus videos (e.g., vascular pulsatility index). Current convolutional neural networks (CNNs) developed to detect glaucoma are all based on spatial features embedded in an image. We developed a combined CNN and recurrent neural network (RNN) that not only extracts the spatial features in a fundus image but also the temporal features embedded in a fundus video (i.e., sequential images). A total of 1810 fundus images and 295 fundus videos were used to train a CNN and a combined CNN and Long Short-Term Memory RNN. The combined CNN/RNN model reached an average F-measure of 96.2% in separating glaucoma from healthy eyes. In contrast, the base CNN model reached an average F-measure of only 79.2%. This proof-of-concept study demonstrates that extracting spatial and temporal features from fundus videos using a combined CNN and RNN, can markedly enhance the accuracy of glaucoma detection.

Authors

  • Soheila Gheisari
    Vision Science Group, Graduate School of Health, University of Technology Sydney, Australia. Electronic address: soheila.gheisari@uts.edu.au.
  • Sahar Shariflou
    Vision Science Group, Graduate School of Health, University of Technology Sydney, Sydney, Australia.
  • Jack Phu
    Centre for Eye Health, School of Optometry and Vision Science, University of New South Wales, Sydney, Australia.
  • Paul J Kennedy
    Centre for Quantum Computation & Intelligent Systems (QCIS), Faculty of Engineering and Information Technology (FEIT), University of Technology Sydney (UTS), Broadway NSW 2007, Australia.
  • Ashish Agar
    Department of Ophthalmology, Prince of Wales Hospital, Sydney, Australia.
  • Michael Kalloniatis
    Centre for Eye Health, and School of Optometry and Vision Science, The University of New South Wales, Kensington, Australia.
  • S Mojtaba Golzan
    Vision Science Group, Graduate School of Health, University of Technology Sydney, Sydney, Australia.