Learning Tubule-Sensitive CNNs for Pulmonary Airway and Artery-Vein Segmentation in CT.

Journal: IEEE transactions on medical imaging
Published Date:

Abstract

Training convolutional neural networks (CNNs) for segmentation of pulmonary airway, artery, and vein is challenging due to sparse supervisory signals caused by the severe class imbalance between tubular targets and background. We present a CNNs-based method for accurate airway and artery-vein segmentation in non-contrast computed tomography. It enjoys superior sensitivity to tenuous peripheral bronchioles, arterioles, and venules. The method first uses a feature recalibration module to make the best use of features learned from the neural networks. Spatial information of features is properly integrated to retain relative priority of activated regions, which benefits the subsequent channel-wise recalibration. Then, attention distillation module is introduced to reinforce representation learning of tubular objects. Fine-grained details in high-resolution attention maps are passing down from one layer to its previous layer recursively to enrich context. Anatomy prior of lung context map and distance transform map is designed and incorporated for better artery-vein differentiation capacity. Extensive experiments demonstrated considerable performance gains brought by these components. Compared with state-of-the-art methods, our method extracted much more branches while maintaining competitive overall segmentation performance. Codes and models are available at http://www.pami.sjtu.edu.cn/News/56.

Authors

  • Yulei Qin
    Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, 800 Dongchuan RD. Minhang District, Shanghai, 200240, China.
  • Hao Zheng
    Gilead Sciences, Inc, Foster City, California, USA.
  • Yun Gu
    Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, SEIEE Building 2-427, No. 800, Dongchuan Road, Minhang District, Shanghai, 200240 China.
  • Xiaolin Huang
    Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, 200240, Shanghai, P.R. China.
  • Jie Yang
    Key Laboratory of Development and Maternal and Child Diseases of Sichuan Province, Department of Pediatrics, Sichuan University, Chengdu, China.
  • Lihui Wang
    Shanghai Mental Health Center, Shanghai Jiao Tong University, School of Medicine, Shanghai, China.
  • Feng Yao
  • Yue-Min Zhu
    University Lyon, INSA Lyon, CNRS, INSERM, CREATIS UMR 5220, U1206, F-69621, Lyon, France.
  • Guang-Zhong Yang
    Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China. dgunning@fb.com gzyang@sjtu.edu.cn.