Improving Medical Images Classification With Label Noise Using Dual-Uncertainty Estimation.

Journal: IEEE transactions on medical imaging
Published Date:

Abstract

Deep neural networks are known to be data-driven and label noise can have a marked impact on model performance. Recent studies have shown great robustness to classic image recognition even under a high noisy rate. In medical applications, learning from datasets with label noise is more challenging since medical imaging datasets tend to have instance-dependent noise (IDN) and suffer from high observer variability. In this paper, we systematically discuss the two common types of label noise in medical images - disagreement label noise from inconsistency expert opinions and single-target label noise from biased aggregation of individual annotations. We then propose an uncertainty estimation-based framework to handle these two label noise amid the medical image classification task. We design a dual-uncertainty estimation approach to measure the disagreement label noise and single-target label noise via improved Direct Uncertainty Prediction and Monte-Carlo-Dropout. A boosting-based curriculum training procedure is later introduced for robust learning. We demonstrate the effectiveness of our method by conducting extensive experiments on three different diseases with synthesized and real-world label noise: skin lesions, prostate cancer, and retinal diseases. We also release a large re-engineered database that consists of annotations from more than ten ophthalmologists with an unbiased golden standard dataset for evaluation and benchmarking. The dataset is available at https://mmai.group/peoples/julie/.

Authors

  • Lie Ju
  • Xin Wang
    Key Laboratory of Bio-based Material Science & Technology (Northeast Forestry University), Ministry of Education, Harbin 150040, China.
  • Lin Wang
    Department of Engineering Mechanics, Tsinghua University, Beijing 100084, China.
  • Dwarikanath Mahapatra
    Department of Computer Science, ETH Zurich, Switzerland. Electronic address: dwarikanath.mahapatra@inf.ethz.ch.
  • Xin Zhao
    Florida International University.
  • Quan Zhou
    Department of Medical Laboratory, General Hospital of Southern Theater of PLA, Guangzhou 51010, China.
  • Tongliang Liu
  • Zongyuan Ge
    AIM for Health Lab, Faculty of IT, Monash University, Clayton, Victoria, Australia; Monash-Airdoc Research Lab, Faculty of IT, Monash University, Clayton, Victoria, Australia.