HAL-IA: A Hybrid Active Learning framework using Interactive Annotation for medical image segmentation.

Journal: Medical image analysis
PMID:

Abstract

High performance of deep learning models on medical image segmentation greatly relies on large amount of pixel-wise annotated data, yet annotations are costly to collect. How to obtain high accuracy segmentation labels of medical images with limited cost (e.g. time) becomes an urgent problem. Active learning can reduce the annotation cost of image segmentation, but it faces three challenges: the cold start problem, an effective sample selection strategy for segmentation task and the burden of manual annotation. In this work, we propose a Hybrid Active Learning framework using Interactive Annotation (HAL-IA) for medical image segmentation, which reduces the annotation cost both in decreasing the amount of the annotated images and simplifying the annotation process. Specifically, we propose a novel hybrid sample selection strategy to select the most valuable samples for segmentation model performance improvement. This strategy combines pixel entropy, regional consistency and image diversity to ensure that the selected samples have high uncertainty and diversity. In addition, we propose a warm-start initialization strategy to build the initial annotated dataset to avoid the cold-start problem. To simplify the manual annotation process, we propose an interactive annotation module with suggested superpixels to obtain pixel-wise label with several clicks. We validate our proposed framework with extensive segmentation experiments on four medical image datasets. Experimental results showed that the proposed framework achieves high accuracy pixel-wise annotations and models with less labeled data and fewer interactions, outperforming other state-of-the-art methods. Our method can help physicians efficiently obtain accurate medical image segmentation results for clinical analysis and diagnosis.

Authors

  • Xiaokang Li
    Department of Electronic Engineering, School of Information Science and Technology, Fudan University, Shanghai, China.
  • Menghua Xia
  • Jing Jiao
    Department of Electronic Engineering, Fudan University, Shanghai 200433, China.
  • Shichong Zhou
    Department of Ultrasound, Fudan University Shanghai Cancer Center, Shanghai, 200032, China.
  • Cai Chang
    Department of Ultrasound, Fudan University Shanghai Cancer Center, Shanghai, 200032, China.
  • Yuanyuan Wang
    Department of Biotechnology, College of Life Science and Technology, Jinan University Guangzhou, 510632, China.
  • Yi Guo
    Department of Respiratory and Critical Care Medicine, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 200025, China.