Development and validation of a machine learning model to predict mortality risk in patients with COVID-19.

Journal: BMJ health & care informatics
PMID:

Abstract

New York City quickly became an epicentre of the COVID-19 pandemic. An ability to triage patients was needed due to a sudden and massive increase in patients during the COVID-19 pandemic as healthcare providers incurred an exponential increase in workload,which created a strain on the staff and limited resources. Further, methods to better understand and characterise the predictors of morbidity and mortality was needed. METHODS: We developed a prediction model to predict patients at risk for mortality using only laboratory, vital and demographic information readily available in the electronic health record on more than 3395 hospital admissions with COVID-19. Multiple methods were applied, and final model was selected based on performance. A variable importance algorithm was used for interpretability, and understanding of performance and predictors was applied to the best model. We built a model with an area under the receiver operating characteristic curve of 83-97 to identify predictors and patients with high risk of mortality due to COVID-19. Oximetry, respirations, blood urea nitrogen, lymphocyte per cent, calcium, troponin and neutrophil percentage were important features, and key ranges were identified that contributed to a 50% increase in patients' mortality prediction score. With an increasing negative predictive value starting 0.90 after the second day of admission suggests we might be able to more confidently identify likely survivors DISCUSSION: This study serves as a use case of a machine learning methods with visualisations to aide clinicians with a better understanding of the model and predictors of mortality. CONCLUSION: As we continue to understand COVID-19, computer assisted algorithms might be able to improve the care of patients.

Authors

  • Anna Stachel
    Department of Infection Prevention and Control, NYU Langone Health, New York, NY, USA anna.stachel@nyulangone.org.
  • Kwesi Daniel
    Department of Infection Prevention and Control, NYU Langone Health, New York, NY, USA.
  • Dan Ding
    a Department of Veterans Affairs , Human Engineering Research Laboratories , Pittsburgh , PA , USA.
  • Fritz Francois
    Department of Medicine, NYU Grossman School of Medicine, New York, NY, USA.
  • Michael Phillips
    Harry Perkins Institute of Medical Research, Perth, Western Australia, Australia.
  • Jennifer Lighter
    Department of Pediatrics, Division of Pediatric Infectious Diseases, NYU Grossman School of Medicine, New York, NY, USA.