Shareable artificial intelligence to extract cancer outcomes from electronic health records for precision oncology research.

Journal: Nature communications
Published Date:

Abstract

Databases that link molecular data to clinical outcomes can inform precision cancer research into novel prognostic and predictive biomarkers. However, outside of clinical trials, cancer outcomes are typically recorded only in text form within electronic health records (EHRs). Artificial intelligence (AI) models have been trained to extract outcomes from individual EHRs. However, patient privacy restrictions have historically precluded dissemination of these models beyond the centers at which they were trained. In this study, the vulnerability of text classification models trained directly on protected health information to membership inference attacks is confirmed. A teacher-student distillation approach is applied to develop shareable models for annotating outcomes from imaging reports and medical oncologist notes. 'Teacher' models trained on EHR data from Dana-Farber Cancer Institute (DFCI) are used to label imaging reports and discharge summaries from the Medical Information Mart for Intensive Care (MIMIC)-IV dataset. 'Student' models are trained to use these MIMIC documents to predict the labels assigned by teacher models and sent to Memorial Sloan Kettering (MSK) for evaluation. The student models exhibit high discrimination across outcomes in both the DFCI and MSK test sets. Leveraging private labeling of public datasets to distill publishable clinical AI models from academic centers could facilitate deployment of machine learning to accelerate precision oncology research.

Authors

  • Kenneth L Kehl
    Department of Medicine, Dana-Farber Cancer Institute, Boston, MA, 02215, United States.
  • Justin Jee
    Memorial Sloan Kettering Cancer Center, New York, NY 10065, USA. Electronic address: jeej@mskcc.org.
  • Karl Pichotta
    From the Departments of Radiology (N.C.S., V.Y., Y.R.C., D.C.G., J.T., V.H., S.S.H., S.K., J.L., K.J., A.I.H., R.J.Y.), Radiation Oncology (J.T.Y.), Neurosurgery (N.M.), Neurology (J.S.), and Epidemiology and Biostatistics, Division of Computational Oncology, (K.P., J.G., S.P.S.), Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY 10065; Weill Cornell Medical College, New York, NY (J.K.).
  • Morgan A Paul
    Dana-Farber Cancer Institute, 450 Brookline Ave, Boston, MA, USA.
  • Pavel Trukhanov
    Dana-Farber Cancer Institute, 450 Brookline Ave, Boston, MA, USA.
  • Christopher Fong
    Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY, USA.
  • Michele Waters
    Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY, USA.
  • Ziad Bakouny
    Department of Medical Oncology, Dana-Farber Cancer Institute, Boston, MA.
  • Wenxin Xu
    From Dana-Farber Cancer Institute, Boston, MA, USA.
  • Toni K Choueiri
    Lank Center for Genitourinary Oncology, Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA.
  • Chelsea Nichols
    Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY, USA.
  • Deborah Schrag
    Memorial-Sloan Kettering Cancer Center, New York, USA.
  • Nikolaus Schultz
    Department of Epidemiology and Biostatistics, Memorial Sloan Kettering Cancer Center, New York, NY 10065, USA.