A Lesion-Fusion Neural Network for Multi-View Diabetic Retinopathy Grading.

Journal: IEEE journal of biomedical and health informatics
Published Date:

Abstract

As the most common complication of diabetes, diabetic retinopathy (DR) is one of the main causes of irreversible blindness. Automatic DR grading plays a crucial role in early diagnosis and intervention, reducing the risk of vision loss in people with diabetes. In these years, various deep-learning approaches for DR grading have been proposed. Most previous DR grading models are trained using the dataset of single-field fundus images, but the entire retina cannot be fully visualized in a single field of view. There are also problems of scattered location and great differences in the appearance of lesions in fundus images. To address the limitations caused by incomplete fundus features, and the difficulty in obtaining lesion information. This work introduces a novel multi-view DR grading framework, which solves the problem of incomplete fundus features by jointly learning fundus images from multiple fields of view. Furthermore, the proposed model combines multi-view inputs such as fundus images and lesion snapshots. It utilizes heterogeneous convolution blocks (HCB) and scalable self-attention classes (SSAC), which enhance the ability of the model to obtain lesion information. The experimental results show that our proposed method performs better than the benchmark methods on the large-scale dataset.

Authors

  • Xiaoling Luo
    Department of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 610054, PR China.
  • Qihao Xu
  • Zhihua Wang
  • Chao Huang
    University of North Carolina, Chapel Hill, NC, USA.
  • Chengliang Liu
    School of Mechanical Engineering, Shanghai Jiao Tong University, 800 Dongchuan Road, Shanghai 200240, PR China. Electronic address: chlliu@sjtu.edu.cn.
  • Xiaopeng Jin
    College of Big Data and Internet, Shenzhen Technology University, Shenzhen 518055, China.
  • Jianguo Zhang
    College of Automation, Harbin Engineering University, No. 145, Nantong street, Harbin, China.