Dynamic spectrum-driven hierarchical learning network for polyp segmentation.

Journal: Medical image analysis
Published Date:

Abstract

Accurate automatic polyp segmentation in colonoscopy is crucial for the prompt prevention of colorectal cancer. However, the heterogeneous nature of polyps and differences in lighting and visibility conditions present significant challenges in achieving reliable and consistent segmentation across different cases. Therefore, this study proposes a novel dynamic spectrum-driven hierarchical learning model (DSHNet), the first to specifically leverage image frequency domain information to explore region-level salience differences among and within polyps for precise segmentation. A novel spectral decoupler is advanced to separate low-frequency and high-frequency components, leveraging their distinct characteristics to guide the model in learning valuable frequency features without bias through automatic masking. The low-frequency driven region-level saliency modeling then generates dynamic convolution kernels with individual frequency-aware features, which regulate region-level saliency modeling together with the supervision of the hierarchy of labels, thus enabling adaptation to polyp heterogeneous and illumination variation simultaneously. Meanwhile, the high-frequency attention module is designed to preserve the detailed information at the skip connections, which complements the focus on spatial features at various stages. Experimental results demonstrate that the proposed method outperforms other state-of-the-art polyp segmentation techniques, achieving robust and superior results on five diverse datasets. Codes are available at https://github.com/gardnerzhou/DSHNet.

Authors

  • Haolin Wang
    College of Medical Informatics, Chongqing Medical University, Chongqing 400016, People's Republic of China.
  • Kai-Ni Wang
  • Jie Hua
    Department of Gastroenterology, the First Affiliated Hospital of Nanjing Medical University, Nanjing, Jiangsu, China.
  • Yi Tang
    Department of Nephrology, Institute of Nephrology, West China Hospital of Sichuan University, Chengdu, China.
  • Yang Chen
    Orthopedics Department of the First Affiliated Hospital of Tsinghua University, Beijing, China.
  • Guang-Quan Zhou
  • Shuo Li
    Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, Shanghai, China.