Patient safety and quality improvement: Ethical principles for a regulatory approach to bias in healthcare machine learning.

Journal: Journal of the American Medical Informatics Association : JAMIA
Published Date:

Abstract

Accumulating evidence demonstrates the impact of bias that reflects social inequality on the performance of machine learning (ML) models in health care. Given their intended placement within healthcare decision making more broadly, ML tools require attention to adequately quantify the impact of bias and reduce its potential to exacerbate inequalities. We suggest that taking a patient safety and quality improvement approach to bias can support the quantification of bias-related effects on ML. Drawing from the ethical principles underpinning these approaches, we argue that patient safety and quality improvement lenses support the quantification of relevant performance metrics, in order to minimize harm while promoting accountability, justice, and transparency. We identify specific methods for operationalizing these principles with the goal of attending to bias to support better decision making in light of controllable and uncontrollable factors.

Authors

  • Melissa D McCradden
    Division of Neurosurgery (McCradden, Baba, Saha, Boparai, Fadaiefard, Cusimano), St. Michael's Hospital, Unity Health Toronto; Dalla Lana School of Public Health (Cusimano), University of Toronto, Toronto, Ont. injuryprevention@smh.ca.
  • Shalmali Joshi
    Vector Institute, Toronto, Ontario, Canada.
  • James A Anderson
    Department of Bioethics, The Hospital for Sick Children, Toronto, ON, Canada.
  • Mjaye Mazwi
    Department of Critical Care Medicine, The Hospital for Sick Children, Toronto, ON, Canada.
  • Anna Goldenberg
    SickKids Research Institute, 686 Bay Street, Toronto, ON M5G 0A4, Canada; Department of Computer Science, University of Toronto, 40 St. George Street, Toronto, ON M5S 2E4, Canada. Electronic address: anna.goldenberg@utoronto.ca.
  • Randi Zlotnik Shaul
    Bioethics Department, The Hospital for Sick Children, Toronto, Ontario, Canada.