Explainability does not improve biochemistry staff trust in artificial intelligence-based decision support.
Journal:
Annals of clinical biochemistry
PMID:
36112914
Abstract
BACKGROUND: Explainability, the aspect of artificial intelligence-based decision support (ADS) systems that allows users to understand why predictions are made, offers many potential benefits. One common claim is that explainability increases user trust, yet this has not been established in healthcare contexts. For advanced algorithms such as artificial neural networks, the generation of explanations is not trivial, but requires the use of a second algorithm. The assumption of improved user trust should therefore be investigated to determine if it justifies the additional complexity.