Detecting and Remediating Harmful Data Shifts for the Responsible Deployment of Clinical AI Models.

Journal: JAMA network open
Published Date:

Abstract

IMPORTANCE: Clinical artificial intelligence (AI) systems are susceptible to performance degradation due to data shifts, which can lead to erroneous predictions and potential patient harm. Proactively detecting and mitigating these shifts is crucial for maintaining AI effectiveness and safety in clinical practice.

Authors

  • Vallijah Subasri
    Peter Munk Cardiac Center, University Health Network, Toronto, ON, Canada.
  • Amrit Krishnan
    Vector Institute for Artificial Intelligence, Toronto, Ontario, Canada.
  • Ali Kore
    Vector Institute, Toronto, Canada.
  • Azra Dhalla
    Vector Institute, Toronto ON, Canada.
  • Deval Pandya
    Vector Institute for Artificial Intelligence, Toronto, Ontario, Canada.
  • Bo Wang
    Department of Clinical Laboratory Medicine Center, Inner Mongolia Autonomous Region People's Hospital, Hohhot, Inner Mongolia, China.
  • David Malkin
    Genetics and Genome Biology Program, The Hospital for Sick Children, Toronto, Ontario, Canada.
  • Fahad Razak
    St Michael's Hospital, Unity Health Toronto, Toronto, Ontario, Canada.
  • Amol A Verma
    Unity Health Toronto (Verma, Murray, Straus, Pou-Prom, Mamdani); Li Ka Shing Knowledge Institute of St. Michael's Hospital (Verma, Straus, Pou-Prom, Mamdani); Department of Medicine (Verma, Shojania, Straus, Mamdani) and Institute of Health Policy, Management, and Evaluation (Verma, Mamdani) and Department of Statistics (Murray), University of Toronto, Toronto, Ont.; University of Alberta (Greiner); Alberta Machine Intelligence Institute (Greiner), Edmonton, Alta.; Montreal Institute for Learning Algorithms (Cohen), Montréal, Que.; Centre for Quality Improvement and Patient Safety (Shojania), University of Toronto; Sunnybrook Health Sciences Centre (Shojania); Vector Institute (Ghassemi, Mamdani) and Department of Computer Science (Ghassemi); Leslie Dan Faculty of Pharmacy (Mamdani), University of Toronto, Toronto, Ont.; Department of Radiology, Stanford University (Cohen), Stanford, Calif. muhammad.mamdani@unityhealth.to amol.verma@mail.utoronto.ca.
  • Anna Goldenberg
    SickKids Research Institute, 686 Bay Street, Toronto, ON M5G 0A4, Canada; Department of Computer Science, University of Toronto, 40 St. George Street, Toronto, ON M5S 2E4, Canada. Electronic address: anna.goldenberg@utoronto.ca.
  • Elham Dolatabadi