Prototype Learning Guided Hybrid Network for Breast Tumor Segmentation in DCE-MRI.

Journal: IEEE transactions on medical imaging
PMID:

Abstract

Automated breast tumor segmentation on the basis of dynamic contrast-enhancement magnetic resonance imaging (DCE-MRI) has shown great promise in clinical practice, particularly for identifying the presence of breast disease. However, accurate segmentation of breast tumor is a challenging task, often necessitating the development of complex networks. To strike an optimal trade-off between computational costs and segmentation performance, we propose a hybrid network via the combination of convolution neural network (CNN) and transformer layers. Specifically, the hybrid network consists of a encoder-decoder architecture by stacking convolution and deconvolution layers. Effective 3D transformer layers are then implemented after the encoder subnetworks, to capture global dependencies between the bottleneck features. To improve the efficiency of hybrid network, two parallel encoder subnetworks are designed for the decoder and the transformer layers, respectively. To further enhance the discriminative capability of hybrid network, a prototype learning guided prediction module is proposed, where the category-specified prototypical features are calculated through online clustering. All learned prototypical features are finally combined with the features from decoder for tumor mask prediction. The experimental results on private and public DCE-MRI datasets demonstrate that the proposed hybrid network achieves superior performance than the state-of-the-art (SOTA) methods, while maintaining balance between segmentation accuracy and computation cost. Moreover, we demonstrate that automatically generated tumor masks can be effectively applied to identify HER2-positive subtype from HER2-negative subtype with the similar accuracy to the analysis based on manual tumor segmentation. The source code is available at https://github.com/ZhouL-lab/PLHN.

Authors

  • Lei Zhou
    Department of Gastroenterology, The Central Hospital of Wuhan, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China.
  • Yuzhong Zhang
    From the Department of Radiology, Shenzhen Nanshan People's Hospital, Shenzhen University, Taoyuan Rd No. 89, Nanshan District, Shenzhen 518000, Guangdong, China (H.H., Z.D., Y.Q.); Medical AI Laboratory and Guangdong Key Laboratory of Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, China (J.M., R.L., B.H.); Department of Medical Imaging, People's Hospital of Longhua, Shenzhen, Guangdong, China (X.P., Y.Z.); and Department of Radiology, Shenzhen People's Hospital, Shenzhen, Guangdong, China (D.Z., G.H.).
  • Jiadong Zhang
  • Xuejun Qian
    Keck School of Medicine, University of Southern California, Los Angeles, CA, 90033, USA.
  • Chen Gong
    School of Journalism, Fudan University, Shanghai, China.
  • Kun Sun
  • Zhongxiang Ding
  • Xing Wang
    Department of Neurosis and Psychosomatic Diseases, Huzhou Third Municipal Hospital, The Affiliated Hospital of Huzhou University, Huzhou, Zhejiang, China.
  • Zhenhui Li
    College of Information Sciences and Technology, Pennsylvania State University.
  • Zaiyi Liu
    Department of Radiology, Guangdong Provincial People's Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China.
  • Dinggang Shen
    School of Biomedical Engineering, ShanghaiTech University, Shanghai, China.