Artificial Intelligence for Low-Dose CT Lung Cancer Screening: Comparison of Utilization Scenarios.

Journal: AJR. American journal of roentgenology
Published Date:

Abstract

. Artificial intelligence (AI) tools for evaluating low-dose CT (LDCT) lung cancer screening examinations are used predominantly for assisting radiologists' interpretations. Alternate utilization scenarios (e.g., use of AI as a prescreener or backup) warrant consideration. . The purpose of this study was to evaluate the impact of different AI utilization scenarios on diagnostic outcomes and interpretation times for LDCT lung cancer screening. . This retrospective study included 366 individuals (358 men, 8 women; mean age, 64 years) who underwent LDCT from May 2017 to December 2017 as part of an earlier prospective lung cancer screening trial. Examinations were interpreted by one of five readers, who reviewed their assigned cases in two sessions (with and without a commercial AI computer-aided detection tool). These interpretations were used to reconstruct simulated AI utilization scenarios: as an assistant (i.e., radiologists interpret all examinations with AI assistance), as a prescreener (i.e., radiologists only interpret examinations with a positive AI result), or as backup (i.e., radiologists reinterpret examinations when AI suggests a missed finding). A group of thoracic radiologists determined the reference standard. Diagnostic outcomes and mean interpretation times were assessed. Decision-curve analysis was performed. . Compared with interpretation without AI (recall rate, 22.1%; per-nodule sensitivity, 64.2%; per-examination specificity, 88.8%; mean interpretation time, 164 seconds), AI as an assistant showed higher recall rate (30.3%; < .001), lower per-examination specificity (81.1%), and no significant change in per-nodule sensitivity (64.8%; = .86) or mean interpretation time (161 seconds; = .48); AI as a prescreener showed lower recall rate (20.8%; = .02) and mean interpretation time (143 seconds; = .001), higher per-examination specificity (90.3%; = .04), and no significant difference in per-nodule sensitivity (62.9%; = .16); and AI as a backup showed increased recall rate (33.6%; < .001), per-examination sensitivity (66.4%; < .001), and mean interpretation time (225 seconds; = .001), with lower per-examination specificity (79.9%; < .001). Among scenarios, only AI as a prescreener demonstrated higher net benefit than interpretation without AI; AI as an assistant had the least net benefit. . Different AI implementation approaches yield varying outcomes. The findings support use of AI as a prescreener as the preferred scenario. . An approach whereby radiologists only interpret LDCT examinations with a positive AI result can reduce radiologists' workload while preserving sensitivity.

Authors

  • Meesun Lee
    Department of Radiology, Seoul National University Hospital, 101 Daehak-ro, Jongno-gu, Seoul 03080, Republic of Korea.
  • Eui Jin Hwang
    Department of Radiology, Seoul National College of Medicine, Seoul National University Hospital, 101 Daehak-ro, Jongno-gu, Seoul, 03080, Korea (H.C., S.H.Y., S.J.P., C.M.P., J.H.L., H. Kim, E.J.H., S.J.Y., J.G.N., C.H.L., J.M.G.); CHESS Center, The First Hospital of Lanzhou University, Lanzhou, China (Q.X., J.L.); Department of Radiology, Seoul National University Bundang Hospital, Gyeonggi-do, Korea (K.H.L.); Department of Internal Medicine, Incheon Medical Center, Incheon, Korea (J.Y.K.); Department of Radiology, Seoul Medical Center, Seoul, Korea (Y.K.L.); Department of Radiology, National Medical Center, Seoul, Korea (H. Ko); Department of Radiology, Myongji Hospital, Gyeonggi-do, Korea (K.H.K.); and Department of Radiology, Chonnam National University Hospital, Gwanju, Korea (Y.H.K.).
  • Jong Hyuk Lee
    From the Department of Radiology and Institute of Radiation Medicine, Seoul National University Hospital and College of Medicine, 101 Daehak-ro, Jongno-gu, Seoul 03080, Republic of Korea (J.G.N., E.J.H., J.M.G., C.M.P.); Lunit Incorporated, Seoul, Republic of Korea (S.P.); Department of Radiology, Armed Forces Seoul Hospital, Seoul, Republic of Korea (J.H.L.); Department of Radiology, Seoul National University Boramae Medical Center, Seoul, Republic of Korea (K.N.J.); Department of Radiology, National Cancer Center, Goyang, Republic of Korea (K.Y.L.); Department of Radiology and Biomedical Imaging, University of California, San Francisco, San Francisco, Calif (T.H.V., J.H.S.); and Department of Industrial & Information Systems Engineering, Seoul National University of Science and Technology, Seoul, Republic of Korea (S.H.).
  • Ju Gang Nam
    Department of Radiology, Seoul National College of Medicine, Seoul National University Hospital, 101 Daehak-ro, Jongno-gu, Seoul, 03080, Korea (H.C., S.H.Y., S.J.P., C.M.P., J.H.L., H. Kim, E.J.H., S.J.Y., J.G.N., C.H.L., J.M.G.); CHESS Center, The First Hospital of Lanzhou University, Lanzhou, China (Q.X., J.L.); Department of Radiology, Seoul National University Bundang Hospital, Gyeonggi-do, Korea (K.H.L.); Department of Internal Medicine, Incheon Medical Center, Incheon, Korea (J.Y.K.); Department of Radiology, Seoul Medical Center, Seoul, Korea (Y.K.L.); Department of Radiology, National Medical Center, Seoul, Korea (H. Ko); Department of Radiology, Myongji Hospital, Gyeonggi-do, Korea (K.H.K.); and Department of Radiology, Chonnam National University Hospital, Gwanju, Korea (Y.H.K.).
  • Woo Hyeon Lim
    From the Department of Radiology, Seoul National University College of Medicine, 101 Daehak-ro, Jongno-gu, Seoul 03080, Korea (E.J.H., J.G.N., W.H.L., S.J.P., Y.S.J., J.H.K., E.K.H., T.M.K., J.M.G., C.M.P.); and Lunit, Seoul, Korea (S.P., K.H.K.).
  • Hyungin Park
    Department of Radiology, Seoul National University Hospital, 101, Daehak-ro, Jongno-gu, Seoul, 03080, South Korea.
  • Chang Min Park
    Department of Radiology, Seoul National College of Medicine, Seoul National University Hospital, 101 Daehak-ro, Jongno-gu, Seoul, 03080, Korea (H.C., S.H.Y., S.J.P., C.M.P., J.H.L., H. Kim, E.J.H., S.J.Y., J.G.N., C.H.L., J.M.G.); CHESS Center, The First Hospital of Lanzhou University, Lanzhou, China (Q.X., J.L.); Department of Radiology, Seoul National University Bundang Hospital, Gyeonggi-do, Korea (K.H.L.); Department of Internal Medicine, Incheon Medical Center, Incheon, Korea (J.Y.K.); Department of Radiology, Seoul Medical Center, Seoul, Korea (Y.K.L.); Department of Radiology, National Medical Center, Seoul, Korea (H. Ko); Department of Radiology, Myongji Hospital, Gyeonggi-do, Korea (K.H.K.); and Department of Radiology, Chonnam National University Hospital, Gwanju, Korea (Y.H.K.).
  • Hyewon Choi
    Department of Radiology, Seoul National College of Medicine, Seoul National University Hospital, 101 Daehak-ro, Jongno-gu, Seoul, 03080, Korea (H.C., S.H.Y., S.J.P., C.M.P., J.H.L., H. Kim, E.J.H., S.J.Y., J.G.N., C.H.L., J.M.G.); CHESS Center, The First Hospital of Lanzhou University, Lanzhou, China (Q.X., J.L.); Department of Radiology, Seoul National University Bundang Hospital, Gyeonggi-do, Korea (K.H.L.); Department of Internal Medicine, Incheon Medical Center, Incheon, Korea (J.Y.K.); Department of Radiology, Seoul Medical Center, Seoul, Korea (Y.K.L.); Department of Radiology, National Medical Center, Seoul, Korea (H. Ko); Department of Radiology, Myongji Hospital, Gyeonggi-do, Korea (K.H.K.); and Department of Radiology, Chonnam National University Hospital, Gwanju, Korea (Y.H.K.).
  • Jongsoo Park
    Department of Radiology, Seoul National University Hospital, 101, Daehak-ro, Jongno-gu, Seoul, 03080, South Korea.
  • Jin Mo Goo
    Department of Radiology, Seoul National College of Medicine, Seoul National University Hospital, 101 Daehak-ro, Jongno-gu, Seoul, 03080, Korea (H.C., S.H.Y., S.J.P., C.M.P., J.H.L., H. Kim, E.J.H., S.J.Y., J.G.N., C.H.L., J.M.G.); CHESS Center, The First Hospital of Lanzhou University, Lanzhou, China (Q.X., J.L.); Department of Radiology, Seoul National University Bundang Hospital, Gyeonggi-do, Korea (K.H.L.); Department of Internal Medicine, Incheon Medical Center, Incheon, Korea (J.Y.K.); Department of Radiology, Seoul Medical Center, Seoul, Korea (Y.K.L.); Department of Radiology, National Medical Center, Seoul, Korea (H. Ko); Department of Radiology, Myongji Hospital, Gyeonggi-do, Korea (K.H.K.); and Department of Radiology, Chonnam National University Hospital, Gwanju, Korea (Y.H.K.).

Keywords

No keywords available for this article.