Domain-invariant interpretable fundus image quality assessment.

Journal: Medical image analysis
Published Date:

Abstract

Objective and quantitative assessment of fundus image quality is essential for the diagnosis of retinal diseases. The major factors in fundus image quality assessment are image artifact, clarity, and field definition. Unfortunately, most of existing quality assessment methods focus on the quality of overall image, without interpretable quality feedback for real-time adjustment. Furthermore, these models are often sensitive to the specific imaging devices, and cannot generalize well under different imaging conditions. This paper presents a new multi-task domain adaptation framework to automatically assess fundus image quality. The proposed framework provides interpretable quality assessment with both quantitative scores and quality visualization for potential real-time image recapture with proper adjustment. In particular, the present approach can detect optic disc and fovea structures as landmarks, to assist the assessment through coarse-to-fine feature encoding. The framework also exploit semi-tied adversarial discriminative domain adaptation to make the model generalizable across different data sources. Experimental results demonstrated that the proposed algorithm outperforms different state-of-the-art approaches and achieves an area under the ROC curve of 0.9455 for the overall quality classification.

Authors

  • Yaxin Shen
    Department of Computer Science and Engineering, Shanghai Jiao Tong University, China; MoE Key Lab of Artificial Intelligence, AI Institute, Shanghai Jiao Tong University, China.
  • Bin Sheng
    MOE Key Laboratory of AI, School of Electronic, Information, and Electrical Engineering, Shanghai Jiao Tong University, Shanghai, China.
  • Ruogu Fang
    J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL.
  • Huating Li
    Shanghai Jiao Tong University Affiliated Sixth People's Hospital, China. Electronic address: huarting99@sjtu.edu.cn.
  • Ling Dai
    Department of Computer Science and Engineering, Shanghai Jiao Tong University, China; MoE Key Lab of Artificial Intelligence, AI Institute, Shanghai Jiao Tong University, China.
  • Skylar Stolte
    Department of Biomedical Engineering, University of Florida, United States.
  • Jing Qin
    School of Nursing, The Hong Kong Polytechnic University, Hong Kong, China.
  • Weiping Jia
    Department of Endocrinology and Metabolism, Shanghai Jiao Tong University Affiliated Sixth People's Hospital, Shanghai Clinical Center for Diabetes, Shanghai Key Laboratory of Diabetes Mellitus, Shanghai Diabetes Institute Shanghai 200233, China.
  • Dinggang Shen
    School of Biomedical Engineering, ShanghaiTech University, Shanghai, China.