All-Around Real Label Supervision: Cyclic Prototype Consistency Learning for Semi-Supervised Medical Image Segmentation.

Journal: IEEE journal of biomedical and health informatics
Published Date:

Abstract

Semi-supervised learning has substantially advanced medical image segmentation since it alleviates the heavy burden of acquiring the costly expert-examined annotations. Especially, the consistency-based approaches have attracted more attention for their superior performance, wherein the real labels are only utilized to supervise their paired images via supervised loss while the unlabeled images are exploited by enforcing the perturbation-based "unsupervised" consistency without explicit guidance from those real labels. However, intuitively, the expert-examined real labels contain more reliable supervision signals. Observing this, we ask an unexplored but interesting question: can we exploit the unlabeled data via explicit real label supervision for semi-supervised training? To this end, we discard the previous perturbation-based consistency but absorb the essence of non-parametric prototype learning. Based on the prototypical networks, we then propose a novel cyclic prototype consistency learning (CPCL) framework, which is constructed by a labeled-to-unlabeled (L2U) prototypical forward process and an unlabeled-to-labeled (U2L) backward process. Such two processes synergistically enhance the segmentation network by encouraging morediscriminative and compact features. In this way, our framework turns previous "unsupervised" consistency into new "supervised" consistency, obtaining the "all-around real label supervision" property of our method. Extensive experiments on brain tumor segmentation from MRI and kidney segmentation from CT images show that our CPCL can effectively exploit the unlabeled data and outperform other state-of-the-art semi-supervised medical image segmentation methods.

Authors

  • Zhe Xu
    Thayer School of Engineering at Dartmouth College Hanover NH USA john.zhang@dartmouth.edu.
  • Yixin Wang
    Structural Biophysics Group, School of Optometry and Vision Sciences, Cardiff University, Cardiff, Wales, UK.
  • Donghuan Lu
    Simon Fraser University, School of Engineering Science, Burnaby BC V5A 1S6, Canada.
  • Lequan Yu
  • Jiangpeng Yan
    Shenzhen International Graduate School, Tsinghua University, Shenzhen, Guangdong, China.
  • Jie Luo
  • Kai Ma
    Tencent Jarvis Lab, Shenzhen, 518057, China.
  • Yefeng Zheng
  • Raymond Kai-yu Tong
    Interdisciplinary Division of Biomedical Engineering, the Hong Kong Polytechnic University, Hong Kong, SAR Department of Electronic Engineering, the Chinese University of Hong Kong, Hong Kong, SAR kytong@cuhk.edu.hk.