Deep Neural Networks Improve Radiologists' Performance in Breast Cancer Screening.

Journal: IEEE transactions on medical imaging
Published Date:

Abstract

We present a deep convolutional neural network for breast cancer screening exam classification, trained, and evaluated on over 200000 exams (over 1000000 images). Our network achieves an AUC of 0.895 in predicting the presence of cancer in the breast, when tested on the screening population. We attribute the high accuracy to a few technical advances. 1) Our network's novel two-stage architecture and training procedure, which allows us to use a high-capacity patch-level network to learn from pixel-level labels alongside a network learning from macroscopic breast-level labels. 2) A custom ResNet-based network used as a building block of our model, whose balance of depth and width is optimized for high-resolution medical images. 3) Pretraining the network on screening BI-RADS classification, a related task with more noisy labels. 4) Combining multiple input views in an optimal way among a number of possible choices. To validate our model, we conducted a reader study with 14 readers, each reading 720 screening mammogram exams, and show that our model is as accurate as experienced radiologists when presented with the same data. We also show that a hybrid model, averaging the probability of malignancy predicted by a radiologist with a prediction of our neural network, is more accurate than either of the two separately. To further understand our results, we conduct a thorough analysis of our network's performance on different subpopulations of the screening population, the model's design, training procedure, errors, and properties of its internal representations. Our best models are publicly available at https://github.com/nyukat/breast_cancer_classifier.

Authors

  • Nan Wu
    Department of Pharmaceutical Sciences and Computational Chemical Genomics Screening Center, School of Pharmacy, National Center of Excellence for Computational Drug Abuse Research, Drug Discovery Institute, Departments of Computational Biology and Structural Biology, School of Medicine , University of Pittsburgh , Pittsburgh , Pennsylvania 15261 , United States.
  • Jason Phang
  • Jungkyu Park
  • Yiqiu Shen
  • Zhe Huang
  • Masha Zorin
  • Stanislaw Jastrzebski
  • Thibault Fevry
  • Joe Katsnelson
  • Eric Kim
  • Stacey Wolfson
  • Ujas Parikh
  • Sushma Gaddam
  • Leng Leng Young Lin
  • Kara Ho
  • Joshua D Weinstein
  • Beatriu Reig
    The Department of Radiology, New York University School of Medicine, New York, New York, USA.
  • Yiming Gao
    1 Department of Radiology, New York University School of Medicine, 160 E 34th St, New York, NY 10016.
  • Hildegard Toth
  • Kristine Pysarenko
  • Alana Lewin
  • Jiyon Lee
  • Krystal Airola
  • Eralda Mema
    Department of Radiology, Columbia University Medical Center, 622 West 168th Street, PB-1-301, New York, NY, 10032, USA.
  • Stephanie Chung
  • Esther Hwang
  • Naziya Samreen
  • S Gene Kim
  • Laura Heacock
    Bernard and Irene Schwartz Center for Biomedical Imaging, Department of Radiology, New York University School of Medicine, New York, New York, USA.
  • Linda Moy
    1 Department of Radiology, New York University School of Medicine, 160 E 34th St, New York, NY 10016.
  • Kyunghyun Cho
    Department of Information and Computer Science, Aalto University School of Science, Finland.
  • Krzysztof J Geras
    2 Center for Biomedical Imaging, Department of Radiology, New York University School of Medicine, New York, NY.