Performance of Lung Cancer Prediction Models for Screening-detected, Incidental, and Biopsied Pulmonary Nodules.

Journal: Radiology. Artificial intelligence
PMID:

Abstract

Purpose To evaluate the performance of eight lung cancer prediction models on patient cohorts with screening-detected, incidentally detected, and bronchoscopically biopsied pulmonary nodules. Materials and Methods This study retrospectively evaluated promising predictive models for lung cancer prediction in three clinical settings: lung cancer screening with low-dose CT, incidentally detected pulmonary nodules, and nodules deemed suspicious enough to warrant a biopsy. The area under the receiver operating characteristic curve of eight validated models, including logistic regressions on clinical variables and radiologist nodule characterizations, artificial intelligence (AI) on chest CT scans, longitudinal imaging AI, and multimodal approaches for prediction of lung cancer risk was assessed in nine cohorts ( = 898, 896, 882, 219, 364, 117, 131, 115, 373) from multiple institutions. Each model was implemented from their published literature, and each cohort was curated from primary data sources collected over periods from 2002 to 2021. Results No single predictive model emerged as the highest-performing model across all cohorts, but certain models performed better in specific clinical contexts. Single-time-point chest CT AI performed well for screening-detected nodules but did not generalize well to other clinical settings. Longitudinal imaging and multimodal models demonstrated comparatively good performance on incidentally detected nodules. When applied to biopsied nodules, all models showed low performance. Conclusion Eight lung cancer prediction models failed to generalize well across clinical settings and sites outside of their training distributions. Diagnosis, Classification, Application Domain, Lung © RSNA, 2025 See also commentary by Shao and Niu in this issue.

Authors

  • Thomas Z Li
    Department of Biomedical Engineering, Vanderbilt University, Nashville, Tennessee, USA.
  • Kaiwen Xu
    Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN 37235, USA.
  • Aravind Krishnan
    Department of Electrical and Computer Engineering, Vanderbilt University, Nashville, Tenn.
  • Riqiang Gao
    Vanderbilt University, , Nashville, USA.
  • Michael N Kammer
    Vanderbilt University Medical Center, Nashville, TN. Electronic address: Michael.kammer@vumc.org.
  • Sanja Antic
    Cancer Early Detection and Prevention Initiative, Vanderbilt Ingram Cancer Center, Division of Allergy, Pulmonary and Critical Care Medicine.
  • David Xiao
    Department of Thoracic Surgery, Vanderbilt University Medical Center, Nashville, Tenn.
  • Michael Knight
    Vascular, Endovascular & Transplantation Service, Wellington Regional Hospital, Wellington, New Zealand.
  • Yency Martinez
    Division of Allergy, Pulmonary and Critical Care Medicine, Department of Medicine, Vanderbilt University Medical Center, Nashville, Tenn.
  • Rafael Paez
    Division of Allergy, Pulmonary and Critical Care Medicine, Department of Medicine, Vanderbilt University Medical Center, Nashville, Tenn.
  • Robert J Lentz
    Division of Allergy, Pulmonary and Critical Care Medicine, Department of Medicine, Vanderbilt University Medical Center, Nashville, Tenn.
  • Stephen Deppen
    Vanderbilt University Medical Center, Nashville, TN, 37235, USA.
  • Eric L Grogan
    Department of Thoracic Surgery, Vanderbilt University Medical Center, Nashville, Tenn.
  • Thomas A Lasko
    Vanderbilt University School of Medicine, Nashville, TN.
  • Kim L Sandler
    Radiology, Vanderbilt University Medical Center, Nashville, TN 37235, USA.
  • Fabien Maldonado
    Mechanical Engineering Department, Vanderbilt University, Nashville, TN, USA.
  • Bennett A Landman
    Vanderbilt University, Nashville TN 37235, USA.