ThreeF-Net: Fine-grained feature fusion network for breast ultrasound image segmentation.

Journal: Computers in biology and medicine
Published Date:

Abstract

Convolutional Neural Networks (CNNs) have achieved remarkable success in breast ultrasound image segmentation, but they still face several challenges when dealing with breast lesions. Due to the limitations of CNNs in modeling long-range dependencies, they often perform poorly in handling issues such as similar intensity distributions, irregular lesion shapes, and blurry boundaries, leading to low segmentation accuracy. To address these issues, we propose the ThreeF-Net, a fine-grained feature fusion network. This network combines the advantages of CNNs and Transformers, aiming to simultaneously capture local features and model long-range dependencies, thereby improving the accuracy and stability of segmentation tasks. Specifically, we designed a Transformer-assisted Dual Encoder Architecture (TDE), which integrates convolutional modules and self-attention modules to achieve collaborative learning of local and global features. Additionally, we designed a Global Group Feature Extraction (GGFE) module, which effectively fuses the features learned by CNNs and Transformers, enhancing feature representation ability. To further improve model performance, we also introduced a Dynamic Fine-grained Convolution (DFC) module, which significantly improves lesion boundary segmentation accuracy by dynamically adjusting convolution kernels and capturing multi-scale features. Comparative experiments with state-of-the-art segmentation methods on three public breast ultrasound datasets demonstrate that ThreeF-Net outperforms existing methods across multiple key evaluation metrics.

Authors

  • Xuesheng Bian
    Fujian Key Laboratory of Sensing and Computing for Smart City, School of Informatics, Xiamen University, Xiamen, 361005, China. Electronic address: xsbian@stu.xmu.edu.cn.
  • Jia Liu
    Department of Colorectal Oncology, Tianjin Medical University Cancer Institute and Hospital, National Clinical Research Center for Cancer, Tianjin's Clinical Research Center for Cancer, Tianjin Key Laboratory of Digestive Cancer, Tianjin, China.
  • Sen Xu
    National Medical Center for Major Public Health Events, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430000, China.
  • Weiquan Liu
    Fujian Key Laboratory of Sensing and Computing for Smart City, School of Informatics, Xiamen University, Xiamen, 361005, China. Electronic address: wqliu@xmu.edu.cn.
  • Leyi Mei
    National Research Facility for Phenotypic & Genetic Analysis of Model Animals (Primate Facility), Key Laboratory of Genetic Evolution & Animal Models, and National Resource Center for Nonhuman Primates, Kunming Institute of Zoology, Chinese Academy of Sciences, East Jiaochang Road No. 32, Kunming, 650221, Yunnan, China.
  • Chaoshen Xiao
    National Key Laboratory of Radar Signal Processing, Xidian university, No. 2 South Taibai Road, Xian, 710071, Shaanxi, China.
  • Fan Yang
    School of Electrical Engineering and Automation, Jiangsu Normal University, Xuzhou, China.