Robust Stochastic Neural Ensemble Learning With Noisy Labels for Thoracic Disease Classification.

Journal: IEEE transactions on medical imaging
PMID:

Abstract

Chest radiography is the most common radiology examination for thoracic disease diagnosis, such as pneumonia. A tremendous number of chest X-rays prompt data-driven deep learning models in constructing computer-aided diagnosis systems for thoracic diseases. However, in realistic radiology practice, a deep learning-based model often suffers from performance degradation when trained on data with noisy labels possibly caused by different types of annotation biases. To this end, we present a novel stochastic neural ensemble learning (SNEL) framework for robust thoracic disease diagnosis using chest X-rays. The core idea of our method is to learn from noisy labels by constructing model ensembles and designing noise-robust loss functions. Specifically, we propose a fast neural ensemble method that collects parameters simultaneously across model instances and along optimization trajectories. Moreover, we propose a loss function that both optimizes a robust measure and characterizes a diversity measure of ensembles. We evaluated our proposed SNEL method on three publicly available hospital-scale chest X-ray datasets. The experimental results indicate that our method outperforms competing methods and demonstrate the effectiveness and robustness of our method in learning from noisy labels. Our code is available at https://github.com/hywang01/SNEL.

Authors

  • Hongyu Wang
    School of Information Science and Technology, Northwest University, Xi'an, Shaanxi, China.
  • Jiang He
    Cardiovascular Medicine Department, Affiliated Hospital of North Sichuan Medical College, Nanchong, China.
  • Hengfei Cui
    National Engineering Laboratory for Integrated Aero-Space-Ground-Ocean Big Data Application Technology, School of Computer Science, Northwestern Polytechnical University, China.
  • Bo Yuan
    New Use Agriculture and Natural Plant Products Program, Department of Plant Biology and Center for Agricultural Food Ecosystems, Institute of Food, Nutrition & Health, Rutgers University, 59 Dudley Road, New Brunswick, NJ, 08901, USA.
  • Yong Xia