Segmentation only uses sparse annotations: Unified weakly and semi-supervised learning in medical images.

Journal: Medical image analysis
Published Date:

Abstract

Since segmentation labeling is usually time-consuming and annotating medical images requires professional expertise, it is laborious to obtain a large-scale, high-quality annotated segmentation dataset. We propose a novel weakly- and semi-supervised framework named SOUSA (Segmentation Only Uses Sparse Annotations), aiming at learning from a small set of sparse annotated data and a large amount of unlabeled data. The proposed framework contains a teacher model and a student model. The student model is weakly supervised by scribbles and a Geodesic distance map derived from scribbles. Meanwhile, a large amount of unlabeled data with various perturbations are fed to student and teacher models. The consistency of their output predictions is imposed by Mean Square Error (MSE) loss and a carefully designed Multi-angle Projection Reconstruction (MPR) loss. Extensive experiments are conducted to demonstrate the robustness and generalization ability of our proposed method. Results show that our method outperforms weakly- and semi-supervised state-of-the-art methods on multiple datasets. Furthermore, our method achieves a competitive performance with some fully supervised methods with dense annotation when the size of the dataset is limited.

Authors

  • Feng Gao
    Department of Statistics, UCLA, Los Angeles, CA 90095, USA.
  • Minhao Hu
    SenseTime Research, Shanghai, China.
  • Min-Er Zhong
    Department of Colorectal Surgery, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, Guangdong Province 510655, China; Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, Guangdong Province 510655, China.
  • Shixiang Feng
    SenseTime Research, Shanghai, China.
  • Xuwei Tian
    Clinical Medical Research Center, The First People's Hospital of Kashi Prefecture, Kashi, Xinjiang, China.
  • Xiaochun Meng
    Department of Radiology, The Sixth Affiliated Hospital of Sun Yat-sen University, Guangzhou, Guangdong, 510655, China.
  • Ma-Yi-di-Li Ni-Jia-Ti
    Department of Radiology, The First People's Hospital of Kashi Prefecture, Kashi, Xinjiang, China.
  • Zeping Huang
    Department of Colorectal Surgery, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, Guangdong Province 510655, China; Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, Guangdong Province 510655, China.
  • Minyi Lv
    Department of Colorectal Surgery, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, Guangdong Province 510655, China; Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, Guangdong Province 510655, China.
  • Tao Song
    Department of Cleft Lip and Palate, Plastic Surgery Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing.
  • Xiaofan Zhang
  • Xiaoguang Zou
    The First People's Hospital of Kashi, Xinjiang, China.
  • Xiaojian Wu
    Department of Colorectal Surgery, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China. wuxjian@mail.sysu.edu.cn.