Performance of an Artificial Intelligence System for Breast Cancer Detection on Screening Mammograms from BreastScreen Norway.

Journal: Radiology. Artificial intelligence
PMID: 38597784

Abstract

Purpose To explore the stand-alone breast cancer detection performance, at different risk score thresholds, of a commercially available artificial intelligence (AI) system. Materials and Methods This retrospective study included information from 661 695 digital mammographic examinations performed among 242 629 female individuals screened as a part of BreastScreen Norway, 2004-2018. The study sample included 3807 screen-detected cancers and 1110 interval breast cancers. A continuous examination-level risk score by the AI system was used to measure performance as the area under the receiver operating characteristic curve (AUC) with 95% CIs and cancer detection at different AI risk score thresholds. Results The AUC of the AI system was 0.93 (95% CI: 0.92, 0.93) for screen-detected cancers and interval breast cancers combined and 0.97 (95% CI: 0.97, 0.97) for screen-detected cancers. In a setting where 10% of the examinations with the highest AI risk scores were defined as positive and 90% with the lowest scores as negative, 92.0% (3502 of 3807) of the screen-detected cancers and 44.6% (495 of 1110) of the interval breast cancers were identified with AI. In this scenario, 68.5% (10 987 of 16 040) of false-positive screening results (negative recall assessment) were considered negative by AI. When 50% was used as the cutoff, 99.3% (3781 of 3807) of the screen-detected cancers and 85.2% (946 of 1110) of the interval breast cancers were identified as positive by AI, whereas 17.0% (2725 of 16 040) of the false-positive results were considered negative. Conclusion The AI system showed high performance in detecting breast cancers within 2 years of screening mammography and a potential for use to triage low-risk mammograms to reduce radiologist workload. Mammography, Breast, Screening, Convolutional Neural Network (CNN), Deep Learning Algorithms . © RSNA, 2024 See also commentary by Bahl and Do in this issue.

Authors

  • Marthe Larsen
    Section for Breast Cancer Screening, Cancer Registry of Norway, Oslo, Norway.
  • Camilla F Olstad
    From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.F.N.), Cancer Registry of Norway, Norwegian Institute of Public Health, PO 5313, Majorstuen, 0304 Oslo, Norway; Department of Radiology, University of Washington School of Medicine, Seattle, Wash (C.I.L.); Department of Health Systems and Population Health, University of Washington School of Public Health, Seattle, Wash (C.I.L.); Department of Radiology, Vestre Viken Hospital Trust, Drammen, Norway (T.H.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation, Medical Imaging, Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); SPKI-The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine, Faculty of Health Sciences (K.Ø.M.), Department of Physics and Technology, Faculty of Science and Technology (J.F.N.), and Department of Health and Care Sciences, Faculty of Health Sciences (S.H.), UiT-The Arctic University of Norway, Tromsø, Norway; Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); Department of Radiology, Innlandet Hospital Trust, Hamar, Norway (M.S.); and Department of Radiology, Innlandet Hospital Trust, Lillehammer, Norway (Å.Ø.S.).
  • Christoph I Lee
    Department of Radiology, University of Washington School of Medicine, Seattle, WA, USA.
  • Tone Hovda
    Department of Radiology, Vestre Viken Hospital Trust, Drammen, Norway.
  • Solveig R Hoff
    From the Section for Breast Cancer Screening (M.L., C.F.A., S.H.) and Department of Register Informatics (J.F.N.), Cancer Registry of Norway (G.U.), P.O. Box 5313, 0304 Oslo, Norway; Department of Health and Care Sciences, Faculty of Health Sciences, The Arctic University of Norway, Tromsø, Norway (S.H.); Department of Radiology, University of Washington School of Medicine, Seattle, Wash (C.I.L.); Department of Health Systems and Population Health, University of Washington School of Public Health, Seattle, Wash (C.I.L.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation and Medical Imaging, Faculty of Medicine and Health Sciences, National University for Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Translational Medicine, Lund University, Lund, Sweden (K.L.); and Unilabs Mammography Unit, Skåne University Hospital, Malmö, Sweden (K.L.).
  • Marit A Martiniussen
    Department of Radiology, Østfold Hospital Trust, Kalnes, Norway; University of Oslo, Institute of Clinical Medicine, Oslo, Norway.
  • Karl Øyvind Mikalsen
    Department of Clinical Medicine, UiT The Arctic University of Norway, Tromso, Norway.
  • Håkon Lund-Hanssen
    From the Section for Breast Cancer Screening (M.L., C.F.A., S.H.) and Department of Register Informatics (J.F.N.), Cancer Registry of Norway (G.U.), P.O. Box 5313, 0304 Oslo, Norway; Department of Health and Care Sciences, Faculty of Health Sciences, The Arctic University of Norway, Tromsø, Norway (S.H.); Department of Radiology, University of Washington School of Medicine, Seattle, Wash (C.I.L.); Department of Health Systems and Population Health, University of Washington School of Public Health, Seattle, Wash (C.I.L.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation and Medical Imaging, Faculty of Medicine and Health Sciences, National University for Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Translational Medicine, Lund University, Lund, Sweden (K.L.); and Unilabs Mammography Unit, Skåne University Hospital, Malmö, Sweden (K.L.).
  • Helene S Solli
    From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.F.N.), Cancer Registry of Norway, Norwegian Institute of Public Health, PO 5313, Majorstuen, 0304 Oslo, Norway; Department of Radiology, University of Washington School of Medicine, Seattle, Wash (C.I.L.); Department of Health Systems and Population Health, University of Washington School of Public Health, Seattle, Wash (C.I.L.); Department of Radiology, Vestre Viken Hospital Trust, Drammen, Norway (T.H.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation, Medical Imaging, Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); SPKI-The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine, Faculty of Health Sciences (K.Ø.M.), Department of Physics and Technology, Faculty of Science and Technology (J.F.N.), and Department of Health and Care Sciences, Faculty of Health Sciences (S.H.), UiT-The Arctic University of Norway, Tromsø, Norway; Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); Department of Radiology, Innlandet Hospital Trust, Hamar, Norway (M.S.); and Department of Radiology, Innlandet Hospital Trust, Lillehammer, Norway (Å.Ø.S.).
  • Marko Silberhorn
    From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.F.N.), Cancer Registry of Norway, Norwegian Institute of Public Health, PO 5313, Majorstuen, 0304 Oslo, Norway; Department of Radiology, University of Washington School of Medicine, Seattle, Wash (C.I.L.); Department of Health Systems and Population Health, University of Washington School of Public Health, Seattle, Wash (C.I.L.); Department of Radiology, Vestre Viken Hospital Trust, Drammen, Norway (T.H.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation, Medical Imaging, Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); SPKI-The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine, Faculty of Health Sciences (K.Ø.M.), Department of Physics and Technology, Faculty of Science and Technology (J.F.N.), and Department of Health and Care Sciences, Faculty of Health Sciences (S.H.), UiT-The Arctic University of Norway, Tromsø, Norway; Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); Department of Radiology, Innlandet Hospital Trust, Hamar, Norway (M.S.); and Department of Radiology, Innlandet Hospital Trust, Lillehammer, Norway (Å.Ø.S.).
  • Åse Ø Sulheim
    From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.F.N.), Cancer Registry of Norway, Norwegian Institute of Public Health, PO 5313, Majorstuen, 0304 Oslo, Norway; Department of Radiology, University of Washington School of Medicine, Seattle, Wash (C.I.L.); Department of Health Systems and Population Health, University of Washington School of Public Health, Seattle, Wash (C.I.L.); Department of Radiology, Vestre Viken Hospital Trust, Drammen, Norway (T.H.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation, Medical Imaging, Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); SPKI-The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine, Faculty of Health Sciences (K.Ø.M.), Department of Physics and Technology, Faculty of Science and Technology (J.F.N.), and Department of Health and Care Sciences, Faculty of Health Sciences (S.H.), UiT-The Arctic University of Norway, Tromsø, Norway; Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); Department of Radiology, Innlandet Hospital Trust, Hamar, Norway (M.S.); and Department of Radiology, Innlandet Hospital Trust, Lillehammer, Norway (Å.Ø.S.).
  • Steinar Auensen
    From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.F.N.), Cancer Registry of Norway, Norwegian Institute of Public Health, PO 5313, Majorstuen, 0304 Oslo, Norway; Department of Radiology, University of Washington School of Medicine, Seattle, Wash (C.I.L.); Department of Health Systems and Population Health, University of Washington School of Public Health, Seattle, Wash (C.I.L.); Department of Radiology, Vestre Viken Hospital Trust, Drammen, Norway (T.H.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation, Medical Imaging, Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); SPKI-The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine, Faculty of Health Sciences (K.Ø.M.), Department of Physics and Technology, Faculty of Science and Technology (J.F.N.), and Department of Health and Care Sciences, Faculty of Health Sciences (S.H.), UiT-The Arctic University of Norway, Tromsø, Norway; Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); Department of Radiology, Innlandet Hospital Trust, Hamar, Norway (M.S.); and Department of Radiology, Innlandet Hospital Trust, Lillehammer, Norway (Å.Ø.S.).
  • Jan F Nygård
    From the Section for Breast Cancer Screening (M.L., C.F.A., S.H.) and Department of Register Informatics (J.F.N.), Cancer Registry of Norway (G.U.), P.O. Box 5313, 0304 Oslo, Norway; Department of Health and Care Sciences, Faculty of Health Sciences, The Arctic University of Norway, Tromsø, Norway (S.H.); Department of Radiology, University of Washington School of Medicine, Seattle, Wash (C.I.L.); Department of Health Systems and Population Health, University of Washington School of Public Health, Seattle, Wash (C.I.L.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation and Medical Imaging, Faculty of Medicine and Health Sciences, National University for Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Translational Medicine, Lund University, Lund, Sweden (K.L.); and Unilabs Mammography Unit, Skåne University Hospital, Malmö, Sweden (K.L.).
  • Solveig Hofvind
    Section for Breast Cancer Screening, Cancer Registry of Norway, Oslo, Norway.

Keywords

External Resources

Popular Topics
Recent Journals