A framework for the oversight and local deployment of safe and high-quality prediction models.

Journal: Journal of the American Medical Informatics Association : JAMIA
Published Date:

Abstract

Artificial intelligence/machine learning models are being rapidly developed and used in clinical practice. However, many models are deployed without a clear understanding of clinical or operational impact and frequently lack monitoring plans that can detect potential safety signals. There is a lack of consensus in establishing governance to deploy, pilot, and monitor algorithms within operational healthcare delivery workflows. Here, we describe a governance framework that combines current regulatory best practices and lifecycle management of predictive models being used for clinical care. Since January 2021, we have successfully added models to our governance portfolio and are currently managing 52 models.

Authors

  • Armando D Bedoya
    Division of Pulmonary, Allergy, and Critical Care Medicine, Duke University School of Medicine, Durham, NC, United States.
  • Nicoleta J Economou-Zavlanos
    Duke University School of Medicine, Durham, North Carolina, USA.
  • Benjamin A Goldstein
    Department of Biostatistics and Bioinformatics, Duke University School of Medicine, Durham, North Carolina.
  • Allison Young
    Duke University School of Medicine, Durham, North Carolina, USA.
  • J Eric Jelovsek
    Department of Obstetrics and Gynecology, Duke University, Durham, North Carolina, USA.
  • Cara O'Brien
    Department of Medicine, Duke University School of Medicine, Durham, NC, United States.
  • Amanda B Parrish
    Duke University School of Medicine, Durham, North Carolina, USA.
  • Scott Elengold
    Office of Counsel, Duke University, Durham, North Carolina, USA.
  • Kay Lytle
    Duke University Health System, Durham, North Carolina, USA.
  • Suresh Balu
    Duke Institute for Health Innovation.
  • Erich Huang
    Duke Clinical Research Institute, Duke University School of Medicine, Box 2834, Durham, NC, 27701, USA.
  • Eric G Poon
    Duke University Health System, Durham, NC, United States.
  • Michael J Pencina
    Duke Clinical Research Institute, Department of Biostatistics and Bioinformatics, Duke University, Durham, North Carolina.