ISGAN: Unsupervised Domain Adaptation With Improved Symmetric GAN for Cross-Modality Multi-Organ Segmentation.

Journal: IEEE journal of biomedical and health informatics
Published Date:

Abstract

The differences between cross-modality medical images are significant, so several studies are working on unsupervised domain adaptation (UDA) segmentation, which aims to adapt a segmentation model trained on a labeled source domain to an unlabeled target domain. The conventional UDA segmentation strategy aims to integrate image generation and segmentation. However, conventional image generation modules only consider information from a single domain (source or target), resulting in visual inconsistencies. The image generation module may also lack anatomical constraints, leading to incorrect pseudo-label generation. To address these issues, we propose an improved symmetric generative adversarial network (ISGAN). Unlike conventional approaches that perform domain adaptation only in the source or target domain, ISGAN adopts a symmetric architecture using two-path domain adaptation to reduce the visual difference. In addition, ISGAN adopts a bidirectional training strategy to optimize the image generation and segmentation modules. The bidirectional training strategy introduces the anatomical constraints into the image generation module, thereby reducing the generation of incorrect pseudo labels. Finally, we validate ISGAN on two cross-modality datasets (the MMWHS cardiac dataset and Abdomen dataset). ISGAN delivers promising segmentation and generalization performance compared with state-of-the-art UDA methods.

Authors

  • Jiapeng Li
    Department of Pharmacy, Peking University People's Hospital, 11 Xizhimen South Street, Xicheng District, Beijing 100044, China; Department of Pharmacy Administration and Clinical Pharmacy, School of Pharmaceutical Sciences, Peking University, 38 Xueyuan Road, Haidian District, Beijing 100191, China.
  • Yifan Zhang
    Department of Food Science and Nutrition, Zhejiang Key Laboratory for Agro-Food Processing, Zhejiang University, Hangzhou, Zhejiang 310058, China.
  • Lisheng Xu
    College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, China.
  • Yudong Yao
    Sino-Dutch Biomedical and Information Engineering School, Northeastern University, Shenyang, China.
  • Lin Qi
    a Sino-Dutch Biomedical and Information Engineering School , Northeastern University , Shenyang , Liaoning , China.