Human factors challenges for the safe use of artificial intelligence in patient care.

Journal: BMJ health & care informatics
Published Date: Nov 1, 2019

Abstract

The use of artificial intelligence (AI) in patient care can offer significant benefits. However, there is a lack of independent evaluation considering AI in use. The paper argues that consideration should be given to how AI will be incorporated into clinical processes and services. Human factors challenges that are likely to arise at this level include cognitive aspects (automation bias and human performance), handover and communication between clinicians and AI systems, situation awareness and the impact on the interaction with patients. Human factors research should accompany the development of AI from the outset.

Authors

  • Mark Sujan
    Warwick Medical School, University of Warwick, Coventry, UK mark.sujan@humanreliability.com.
  • Dominic Furniss
    Human Reliability Associates, Dalton, UK.
  • Kath Grundy
    Patient, Derby, UK.
  • Howard Grundy
    Patient, Derby, UK.
  • David Nelson
    Intensive Care Unit, University Hospitals of Derby and Burton NHS Foundation Trust, Derby, UK.
  • Matthew Elliott
    Intensive Care Unit, University Hospitals of Derby and Burton NHS Foundation Trust, Derby, UK.
  • Sean White
  • Ibrahim Habli
    Department of Computer Science, University of York, York, YO10 5GH, UK. Electronic address: Ibrahim.Habli@york.ac.uk.
  • Nick Reynolds
    Intensive Care Unit, University Hospitals of Derby and Burton NHS Foundation Trust, Derby, UK.

Keywords

External Resources

Popular Topics
Recent Journals