A novel deep learning conditional generative adversarial network for producing angiography images from retinal fundus photographs.

Journal: Scientific reports
Published Date:

Abstract

Fluorescein angiography (FA) is a procedure used to image the vascular structure of the retina and requires the insertion of an exogenous dye with potential adverse side effects. Currently, there is only one alternative non-invasive system based on Optical coherence tomography (OCT) technology, called OCT angiography (OCTA), capable of visualizing retina vasculature. However, due to its cost and limited view, OCTA technology is not widely used. Retinal fundus photography is a safe imaging technique used for capturing the overall structure of the retina. In order to visualize retinal vasculature without the need for FA and in a cost-effective, non-invasive, and accurate manner, we propose a deep learning conditional generative adversarial network (GAN) capable of producing FA images from fundus photographs. The proposed GAN produces anatomically accurate angiograms, with similar fidelity to FA images, and significantly outperforms two other state-of-the-art generative algorithms ([Formula: see text] and [Formula: see text]). Furthermore, evaluations by experts shows that our proposed model produces such high quality FA images that are indistinguishable from real angiograms. Our model as the first application of artificial intelligence and deep learning to medical image translation, by employing a theoretical framework capable of establishing a shared feature-space between two domains (i.e. funduscopy and fluorescein angiography) provides an unrivaled way for the translation of images from one domain to the other.

Authors

  • Alireza Tavakkoli
    Department of Computer Science and Engineering, University of Nevada School of Medicine, Reno, NV 89557, USA.
  • Sharif Amit Kamran
    Department of Computer Science and Engineering, University of Nevada School of Medicine, Reno, NV 89557, USA.
  • Khondker Fariha Hossain
    Department of Computer Science, Deakin University, Melbourne, VIC, 3217, Australia.
  • Stewart Lee Zuckerbrod
    Department of Ophthalmology, Houston Eye Associates, Houston, TX, 77401, USA.