DIPathMamba: A domain-incremental weakly supervised state space model for pathology image segmentation.

Journal: Medical image analysis
Published Date:

Abstract

Accurate segmentation of pathology images plays a crucial role in digital pathology workflow. However, two significant issues exist with the present pathology image segmentation methods: (i) Most fully supervised models rely on dense pixel-level annotations for superior results; (ii) Traditional static models are challenging to handle the massive amount of pathology data in multiple domains. To address these issues, we propose a Domain-Incremental Weakly Supervised State-space Model (DIPathMamba) that not only segments pathology images using image-level labels but also dynamically learns new domain knowledge and preserves the discriminability of previous domains. We first design a shared feature extractor based on the state space model, which employs an efficient hardware-aware design. Specifically, we extract pixel-level feature maps based on Multi-Instance Multi-Label Learning by treating pixels as instances, which are injected into our designed Contrastive Mamba Block (CMB). The CMB adopts a state space model and integrates the concept of contrastive learning to extract non-causal dual-granularity features in pathology images. Subsequently, to mitigate the performance degradation of prior domains during incremental learning, we design a Domain Parameter Constraint Model (DPCM). Finally, we propose a Collaborative Incremental Deep Supervision Loss (CIDSL), which aims to fully utilize the limited annotated information in weakly supervised methods and guide parameter learning during domain increment. Our approach integrates complex details and broader global contextual semantics in pathology images and can generate regionally more consistent segmentation results. Experiments on three public pathology image datasets show that the proposed method performs better than state-of-the-art methods.

Authors

  • Jiansong Fan
    School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi, 214122, China. Electronic address: fan_jiansong@163.com.
  • Qi Sun
    Department of Orthopedics, Shanghai Tenth People's Hospital, Tongji University, School of Medicine, Shanghai, 200072, P.R.China.
  • Yicheng Di
    School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi, 214122, China. Electronic address: diyicheng@stu.jiangnan.edu.cn.
  • Jiayu Bao
    School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi, 214122, China. Electronic address: 7243115008@stu.jiangnan.edu.cn.
  • Tianxu Lv
  • Yuan Liu
    Department of General Surgery, Wuxi People's Hospital Affiliated to Nanjing Medical University, Wuxi, China.
  • Xiaoyun Hu
    Department of Anesthesiology, Beijing Shijitan Hospital, Capital Medical University, Beijing, China.
  • Lihua Li
    College of Life Information Science and Instrument Engineering, Hangzhou Dianzi University, Hangzhou 310018, China. Electronic address: lilh@hdu.edu.cn.
  • Xiaobin Cui
    Department of Pathology, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, Nanjing 210008, Jiangsu Province, China.
  • Xiang Pan
    Department of Biomedical Engineering, Worcester Polytechnic Institute, Worcester, MA 01609, United States of America.