Mammographic Breast Density Assessment Using Deep Learning: Clinical Implementation.

Journal: Radiology
Published Date:

Abstract

Purpose To develop a deep learning (DL) algorithm to assess mammographic breast density. Materials and Methods In this retrospective study, a deep convolutional neural network was trained to assess Breast Imaging Reporting and Data System (BI-RADS) breast density based on the original interpretation by an experienced radiologist of 41 479 digital screening mammograms obtained in 27 684 women from January 2009 to May 2011. The resulting algorithm was tested on a held-out test set of 8677 mammograms in 5741 women. In addition, five radiologists performed a reader study on 500 mammograms randomly selected from the test set. Finally, the algorithm was implemented in routine clinical practice, where eight radiologists reviewed 10 763 consecutive mammograms assessed with the model. Agreement on BI-RADS category for the DL model and for three sets of readings-(a) radiologists in the test set, (b) radiologists working in consensus in the reader study set, and (c) radiologists in the clinical implementation set-were estimated with linear-weighted κ statistics and were compared across 5000 bootstrap samples to assess significance. Results The DL model showed good agreement with radiologists in the test set (κ = 0.67; 95% confidence interval [CI]: 0.66, 0.68) and with radiologists in consensus in the reader study set (κ = 0.78; 95% CI: 0.73, 0.82). There was very good agreement (κ = 0.85; 95% CI: 0.84, 0.86) with radiologists in the clinical implementation set; for binary categorization of dense or nondense breasts, 10 149 of 10 763 (94%; 95% CI: 94%, 95%) DL assessments were accepted by the interpreting radiologist. Conclusion This DL model can be used to assess mammographic breast density at the level of an experienced mammographer. © RSNA, 2018 Online supplemental material is available for this article . See also the editorial by Chan and Helvie in this issue.

Authors

  • Constance D Lehman
    From the Division of Breast Imaging, Department of Radiology, Massachusetts General Hospital/Harvard Medical School, 55 Fruit St, WAC 240, Boston, MA 02114 (M.B., C.D.L.); and Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, Mass (R.B., A.B.Y., N.J.L., L.Y.).
  • Adam Yala
    Department of Electrical Engineering and Computer Science, CSAIL, MIT, Cambridge, USA.
  • Tal Schuster
    From the Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Avon Comprehensive Breast Evaluation Center, 55 Fruit St, WAC 240, Boston, MA 02114-2698 (C.D.L., B.D., M.B.); and Massachusetts Institute of Technology, Cambridge, Mass (A.Y., T.S., K.S., R.B.).
  • Brian Dontchos
    From the Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Avon Comprehensive Breast Evaluation Center, 55 Fruit St, WAC 240, Boston, MA 02114-2698 (C.D.L., B.D., M.B.); and Massachusetts Institute of Technology, Cambridge, Mass (A.Y., T.S., K.S., R.B.).
  • Manisha Bahl
    Massachusetts General Hospital, Department of Radiology, Boston, MA. Electronic address: mbahl1@mgh.harvard.edu.
  • Kyle Swanson
  • Regina Barzilay
    Computer Science and Artificial Intelligence Laboratory , Massachusetts Institute of Technology , 77 Massachusetts Avenue , Cambridge , MA 02139 , USA . Email: regina@csail.mit.edu.