Synergistically segmenting choroidal layer and vessel using deep learning for choroid structure analysis.

Journal: Physics in medicine and biology
Published Date:

Abstract

. The choroid is the most vascularized structure in the human eye, whose layer structure and vessel distribution are both critical for the physiology of the retina, and disease pathogenesis of the eye. Although some works have used graph-based methods or convolutional neural networks to separate the choroid layer from the outer-choroid structure, few works focused on further distinguishing the inner-choroid structure, such as the choroid vessel and choroid stroma.Inspired by the multi-task learning strategy, in this paper, we propose a segmentation pipeline for choroid analysis which can separate the choroid layer from other structures and segment the choroid vessel synergistically. The key component of this pipeline is the proposed choroidal U-shape network (CUNet), which catches both correlation features and specific features between the choroid layer and the choroid vessel. Then pixel-wise classification is generated based on these two types of features to obtain choroid layer segmentation and vessel segmentation. Besides, the training process of CUNet is supervised by a proposed adaptive multi-task segmentation loss which adds a regularization term that is used to balance the performance of the two tasks.Experiments show the high performance (4% higher dice score) and less computational complexity (18.85 M lower size) of our proposed strategy.The high performance and generalization on both choroid layer and vessel segmentation indicate the clinical potential of our proposed pipeline.

Authors

  • Lei Zhu
    School of Civil and Hydraulic Engineering, Ningxia University, Yinchuan, China.
  • Junmeng Li
    Department of Ophthalmology, Peking University First Hospital, Beijing, China.
  • Ruilin Zhu
    Department of Ophthalmology, Peking University First Hospital, Beijing, China.
  • Xiangxi Meng
    Key Laboratory of Carcinogenesis and Translational Research (Ministry of Education/Beijing), Department of Nuclear Medicine, Peking University Cancer Hospital & Institute, Beijing, China.
  • Pei Rong
    Department of Ophthalmology, Peking University First Hospital, Beijing 100034, People's Republic of China.
  • Yibao Zhang
    Key Laboratory of Carcinogenesis and Translational Research (Ministry of Education/Beijing), Department of Radiation Oncology, Peking University Cancer Hospital & Institute, Beijing Cancer Hospital, Beijing, China.
  • Zhe Jiang
    Department of Biomedical Engineering, College of Engineering, Peking University, Beijing, China.
  • Mufeng Geng
  • Bin Qiu
    MOE Key Laboratory for Analytical Science of Food Safety and Biology, Fujian Provincial Key Laboratory of Analysis and Detection for Food Safety, College of Chemistry, Fuzhou University, Fuzhou, Fujian 350116, China.
  • Xin Rong
    Department of Ophthalmology, Peking University First Hospital, Beijing, China.
  • Yadi Zhang
    Department of Ophthalmology, Peking University First Hospital, Beijing, China.
  • Xiaopeng Gu
    Department of Ophthalmology, Peking University First Hospital, Beijing, China.
  • Yuwei Wang
    College of Pharmacy, Shaanxi University of Chinese Medicine, Xianyang, 712000, PR China.
  • Zhiyue Zhang
    Department of Ophthalmology, Peking University First Hospital, Beijing, China.
  • Jing Wang
    Endoscopy Center, Peking University Cancer Hospital and Institute, Beijing, China.
  • Liu Yang
    Department of Ultrasound, Hunan Children's Hospital, Changsha, China.
  • Qiushi Ren
    Department of Biomedical Engineering, Peking University, 100871, Beijing, China.
  • Yanye Lu
    Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Martensstr. 3, 91058, Erlangen, Germany. yanye.lu@fau.de.