How Should AI Be Developed, Validated, and Implemented in Patient Care?

Journal: AMA journal of ethics
Published Date:

Abstract

Should an artificial intelligence (AI) program that appears to have a better success rate than human pathologists be used to replace or augment humans in detecting cancer cells? We argue that some concerns-the "black-box" problem (ie, the unknowability of how output is derived from input) and automation bias (overreliance on clinical decision support systems)-are not significant from a patient's perspective but that expertise in AI is required to properly evaluate test results.

Authors

  • Michael Anderson
    Department of Orthopedics, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, New York, United States.
  • Susan Leigh Anderson
    A professor emerita of philosophy at the University of Connecticut in Storrs, Connecticut.