Latent bias and the implementation of artificial intelligence in medicine.

Journal: Journal of the American Medical Informatics Association : JAMIA
Published Date:

Abstract

Increasing recognition of biases in artificial intelligence (AI) algorithms has motivated the quest to build fair models, free of biases. However, building fair models may be only half the challenge. A seemingly fair model could involve, directly or indirectly, what we call "latent biases." Just as latent errors are generally described as errors "waiting to happen" in complex systems, latent biases are biases waiting to happen. Here we describe 3 major challenges related to bias in AI algorithms and propose several ways of managing them. There is an urgent need to address latent biases before the widespread implementation of AI algorithms in clinical practice.

Authors

  • Matthew DeCamp
    Center for Bioethics and Humanities and Division of General Internal Medicine, University of Colorado, Aurora, CO 80045, USA. Electronic address: matthew.decamp@ucdenver.edu.
  • Charlotta Lindvall
    Harvard Medical School, Boston, MA.