Effect of Uncertainty-Aware AI Models on Pharmacists' Reaction Time and Decision-Making in a Web-Based Mock Medication Verification Task: Randomized Controlled Trial.

Journal: JMIR medical informatics
PMID:

Abstract

BACKGROUND: Artificial intelligence (AI)-based clinical decision support systems are increasingly used in health care. Uncertainty-aware AI presents the model's confidence in its decision alongside its prediction, whereas black-box AI only provides a prediction. Little is known about how this type of AI affects health care providers' work performance and reaction time.

Authors

  • Corey Lester
    Department of Clinical Pharmacy, College of Pharmacy, University of Michigan, Ann Arbor, MI, United States.
  • Brigid Rowell
    Department of Clinical Pharmacy, College of Pharmacy, University of Michigan, Ann Arbor, MI, United States.
  • Yifan Zheng
    Department of Neurology, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, China.
  • Zoe Co
    Division of General Internal Medicine, Brigham and Women's Hospital, Boston, MA, USA.
  • Vincent Marshall
    Department of Clinical Pharmacy, College of Pharmacy, University of Michigan, 428 Church Street, Ann Arbor, MI, 48109, United States, 1 734-647-8849.
  • Jin Yong Kim
    Department of Radiology, Seoul National College of Medicine, Seoul National University Hospital, 101 Daehak-ro, Jongno-gu, Seoul, 03080, Korea (H.C., S.H.Y., S.J.P., C.M.P., J.H.L., H. Kim, E.J.H., S.J.Y., J.G.N., C.H.L., J.M.G.); CHESS Center, The First Hospital of Lanzhou University, Lanzhou, China (Q.X., J.L.); Department of Radiology, Seoul National University Bundang Hospital, Gyeonggi-do, Korea (K.H.L.); Department of Internal Medicine, Incheon Medical Center, Incheon, Korea (J.Y.K.); Department of Radiology, Seoul Medical Center, Seoul, Korea (Y.K.L.); Department of Radiology, National Medical Center, Seoul, Korea (H. Ko); Department of Radiology, Myongji Hospital, Gyeonggi-do, Korea (K.H.K.); and Department of Radiology, Chonnam National University Hospital, Gwanju, Korea (Y.H.K.).
  • Qiyuan Chen
    Department of Industrial and Operations Engineering, College of Engineering, University of Michigan, Ann Arbor, MI, United States.
  • Raed Kontar
    Department of Industrial and Operations Engineering, College of Engineering, University of Michigan, Ann Arbor, MI, United States.
  • X Jessie Yang
    Department of Industrial and Operations Engineering, University of Michigan, Ann Arbor, MI, USA.