Generalized Zero-Shot Chest X-Ray Diagnosis Through Trait-Guided Multi-View Semantic Embedding With Self-Training.

Journal: IEEE transactions on medical imaging
Published Date:

Abstract

Zero-shot learning (ZSL) is one of the most promising avenues of annotation-efficient machine learning. In the era of deep learning, ZSL techniques have achieved unprecedented success. However, the developments of ZSL methods have taken place mostly for natural images. ZSL for medical images has remained largely unexplored. We design a novel strategy for generalized zero-shot diagnosis of chest radiographs. In doing so, we leverage the potential of multi-view semantic embedding, a useful yet less-explored direction for ZSL. Our design also incorporates a self-training phase to tackle the problem of noisy labels alongside improving the performance for classes not seen during training. Through rigorous experiments, we show that our model trained on one dataset can produce consistent performance across test datasets from different sources including those with very different quality. Comparisons with a number of state-of-the-art techniques show the superiority of the proposed method for generalized zero-shot chest x-ray diagnosis.

Authors

  • Angshuman Paul
  • Thomas C Shen
  • Sungwon Lee
    Radiology and Imaging Sciences, Clinical Center, National Institutes of Health, Bldg. 10 Room 1C224D MSC 1182, Bethesda, MD 20892-1182.
  • Niranjan Balachandar
    Department of Radiology and Biomedical Data Science, Stanford University, Palo Alto, CA, 94305, USA.
  • Yifan Peng
    Department of Population Health Sciences, Weill Cornell Medicine, New York, USA.
  • Zhiyong Lu
    National Center for Biotechnology Information, Bethesda, MD 20894 USA.
  • Ronald M Summers
    National Institutes of Health, Clinical Center, Radiology and Imaging Sciences, 10 Center Drive, Bethesda, MD 20892, USA.