Self-co-attention neural network for anatomy segmentation in whole breast ultrasound.

Journal: Medical image analysis
Published Date:

Abstract

The automated whole breast ultrasound (AWBUS) is a new breast imaging technique that can depict the whole breast anatomy. To facilitate the reading of AWBUS images and support the breast density estimation, an automatic breast anatomy segmentation method for AWBUS images is proposed in this study. The problem at hand is quite challenging as it needs to address issues of low image quality, ill-defined boundary, large anatomical variation, etc. To address these issues, a new deep learning encoder-decoder segmentation method based on a self-co-attention mechanism is developed. The self-attention mechanism is comprised of spatial and channel attention module (SC) and embedded in the ResNeXt (i.e., Res-SC) block in the encoder path. A non-local context block (NCB) is further incorporated to augment the learning of high-level contextual cues. The decoder path of the proposed method is equipped with the weighted up-sampling block (WUB) to attain class-specific better up-sampling effect. Meanwhile, the co-attention mechanism is also developed to improve the segmentation coherence among two consecutive slices. Extensive experiments are conducted with comparison to several the state-of-the-art deep learning segmentation methods. The experimental results corroborate the effectiveness of the proposed method on the difficult breast anatomy segmentation problem on AWBUS images.

Authors

  • Baiying Lei
  • Shan Huang
    Tianjin Key Laboratory of Ionic-Molecular Function of Cardiovascular Disease, Department of Cardiology, Tianjin Institute of Cardiology, Second Hospital of Tianjin Medical University, 300211 Tianjin, China.
  • Hang Li
    Beijing Academy of Quantum Information Sciences, Beijing 100193, China.
  • Ran Li
    Department of Automation, Tsinghua University, Beijing, China.
  • Cheng Bian
    Tencent Jarvis Lab, Shenzhen, 518057, China.
  • Yi-Hong Chou
    Department of Radiology, Taipei Veterans General Hospital and National Yang Ming University, Taipei 112, Taiwan.
  • Jing Qin
    School of Nursing, The Hong Kong Polytechnic University, Hong Kong, China.
  • Peng Zhou
    School of International Studies, Zhejiang University, Hangzhou, China.
  • Xuehao Gong
    Department of Ultrasound, Shenzhen Second People's Hospital, First Affiliated Hospital of Shenzhen University, Second People's Hospital of Shenzhen, Shenzhen, 518035, China. Electronic address: fox_gxh@sina.com.
  • Jie-Zhi Cheng
    National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, School of Medicine, Shenzhen University, Shenzhen, Guangdong 518060, P.R. China.