Dual Adversarial Attention Mechanism for Unsupervised Domain Adaptive Medical Image Segmentation.

Journal: IEEE transactions on medical imaging
Published Date:

Abstract

Domain adaptation techniques have been demonstrated to be effective in addressing label deficiency challenges in medical image segmentation. However, conventional domain adaptation based approaches often concentrate on matching global marginal distributions between different domains in a class-agnostic fashion. In this paper, we present a dual-attention domain-adaptative segmentation network (DADASeg-Net) for cross-modality medical image segmentation. The key contribution of DADASeg-Net is a novel dual adversarial attention mechanism, which regularizes the domain adaptation module with two attention maps respectively from the space and class perspectives. Specifically, the spatial attention map guides the domain adaptation module to focus on regions that are challenging to align in adaptation. The class attention map encourages the domain adaptation module to capture class-specific instead of class-agnostic knowledge for distribution alignment. DADASeg-Net shows superior performance in two challenging medical image segmentation tasks.

Authors

  • Xu Chen
    School of Pharmaceutical Sciences, Shenzhen Campus of Sun Yat-sen University, Shenzhen 518107, China.
  • Tianshu Kuang
    Department of Oral and Maxillofacial Surgery, Houston Methodist Research Institute, TX, USA.
  • Hannah Deng
  • Steve H Fung
  • Jaime Gateno
  • James J Xia
  • Pew-Thian Yap
    Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.