Adaptive adversarial neural networks for the analysis of lossy and domain-shifted datasets of medical images.

Journal: Nature biomedical engineering
Published Date:

Abstract

In machine learning for image-based medical diagnostics, supervised convolutional neural networks are typically trained with large and expertly annotated datasets obtained using high-resolution imaging systems. Moreover, the network's performance can degrade substantially when applied to a dataset with a different distribution. Here, we show that adversarial learning can be used to develop high-performing networks trained on unannotated medical images of varying image quality. Specifically, we used low-quality images acquired using inexpensive portable optical systems to train networks for the evaluation of human embryos, the quantification of human sperm morphology and the diagnosis of malarial infections in the blood, and show that the networks performed well across different data distributions. We also show that adversarial learning can be used with unlabelled data from unseen domain-shifted datasets to adapt pretrained supervised networks to new distributions, even when data from the original distribution are not available. Adaptive adversarial networks may expand the use of validated neural-network models for the evaluation of data collected from multiple imaging systems of varying quality without compromising the knowledge stored in the network.

Authors

  • Manoj Kumar Kanakasabapathy
    Division of Engineering in Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA. hshafiee@bwh.harvard.edu.
  • Prudhvi Thirumalaraju
    Division of Engineering in Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA. hshafiee@bwh.harvard.edu.
  • Hemanth Kandula
    Division of Engineering in Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA. hshafiee@bwh.harvard.edu.
  • Fenil Doshi
    Division of Engineering in Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA.
  • Anjali Devi Sivakumar
    Division of Engineering in Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA.
  • Deeksha Kartik
    Division of Engineering in Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts 02139, United States.
  • Raghav Gupta
    Division of Engineering in Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA. hshafiee@bwh.harvard.edu.
  • Rohan Pooniwala
    Division of Engineering in Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA. hshafiee@bwh.harvard.edu.
  • John A Branda
    Department of Pathology, Massachusetts General Hospital and Harvard Medical School, Boston, Massachusetts, USA.
  • Athe M Tsibris
    Division of Infectious Diseases, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA.
  • Daniel R Kuritzkes
    Division of Infectious Diseases, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts 02139, United States.
  • John C Petrozza
    Division of Reproductive Endocrinology and Infertility, Department of Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA.
  • Charles L Bormann
    Department of Obstetrics and Gynecology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA.
  • Hadi Shafiee
    Division of Engineering in Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA. hshafiee@bwh.harvard.edu and Department of Medicine, Harvard Medical School, Boston, MA, USA.