CS-Net: Deep learning segmentation of curvilinear structures in medical imaging.

Journal: Medical image analysis
Published Date:

Abstract

Automated detection of curvilinear structures, e.g., blood vessels or nerve fibres, from medical and biomedical images is a crucial early step in automatic image interpretation associated to the management of many diseases. Precise measurement of the morphological changes of these curvilinear organ structures informs clinicians for understanding the mechanism, diagnosis, and treatment of e.g. cardiovascular, kidney, eye, lung, and neurological conditions. In this work, we propose a generic and unified convolution neural network for the segmentation of curvilinear structures and illustrate in several 2D/3D medical imaging modalities. We introduce a new curvilinear structure segmentation network (CS-Net), which includes a self-attention mechanism in the encoder and decoder to learn rich hierarchical representations of curvilinear structures. Two types of attention modules - spatial attention and channel attention - are utilized to enhance the inter-class discrimination and intra-class responsiveness, to further integrate local features with their global dependencies and normalization, adaptively. Furthermore, to facilitate the segmentation of curvilinear structures in medical images, we employ a 1×3 and a 3×1 convolutional kernel to capture boundary features. Besides, we extend the 2D attention mechanism to 3D to enhance the network's ability to aggregate depth information across different layers/slices. The proposed curvilinear structure segmentation network is thoroughly validated using both 2D and 3D images across six different imaging modalities. Experimental results across nine datasets show the proposed method generally outperforms other state-of-the-art algorithms in various metrics.

Authors

  • Lei Mou
    Cixi Institute of Biomedical Engineering, Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences, Ningbo, China.
  • Yitian Zhao
  • Huazhu Fu
    A*STAR, Singapore, Singapore.
  • Yonghuai Liu
    Department of Computer Science, Edge Hill University, Ormskirk, UK.
  • Jun Cheng
    School of Electrical and Information Technology, Yunnan Minzu University, Kunming, Yunnan 650500, PR China. Electronic address: jcheng6819@126.com.
  • Yalin Zheng
    Department of Eye and Vision Science, University of Liverpool, Liverpool, United Kingdom.
  • Pan Su
    The Russell H. Morgan, Department of Radiology, Johns Hopkins University School of Medicine, Baltimore, Maryland.
  • Jianlong Yang
    Cixi Institute of Biomedical Engineering, Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences, Ningbo, Zhejiang, China.
  • Li Chen
    Department of Endocrinology and Metabolism, Qilu Hospital, Shandong University, Jinan, China.
  • Alejandro F Frangi
    Information and Communication Technologies Department, Universitat Pompeu Fabra, Barcelona, Spain; Department of Mechanical Engineering, The University of Sheffield, United Kingdom.
  • Masahiro Akiba
    R&D Division, TOPCON Corporation, Tokyo, Japan.
  • Jiang Liu
    Department of Pharmacy, The Fourth Hospital of Hebei Medical University Shijiazhuang 050000, Hebei, China.