Style-transfer counterfactual explanations: An application to mortality prevention of ICU patients.

Journal: Artificial intelligence in medicine
PMID:

Abstract

In recent years, machine learning methods have been rapidly adopted in the medical domain. However, current state-of-the-art medical mining methods usually produce opaque, black-box models. To address the lack of model transparency, substantial attention has been given to developing interpretable machine learning models. In the medical domain, counterfactuals can provide example-based explanations for predictions, and show practitioners the modifications required to change a prediction from an undesired to a desired state. In this paper, we propose a counterfactual solution MedSeqCF for preventing the mortality of three cohorts of ICU patients, by representing their electronic health records as medical event sequences, and generating counterfactuals by adopting and employing a text style-transfer technique. We propose three model augmentations for MedSeqCF to integrate additional medical knowledge for generating more trustworthy counterfactuals. Experimental results on the MIMIC-III dataset strongly suggest that augmented style-transfer methods can be effectively adapted for the problem of counterfactual explanations in healthcare applications and can further improve the model performance in terms of validity, BLEU-4, local outlier factor, and edit distance. In addition, our qualitative analysis of the results by consultation with medical experts suggests that our style-transfer solutions can generate clinically relevant and actionable counterfactual explanations.

Authors

  • Zhendong Wang
    Department of Computer and Systems Sciences, Stockholm University, Stockholm, Sweden. Electronic address: zhendong.wang@dsv.su.se.
  • Isak Samsten
    Department of Computer and Systems Sciences, Stockholm University, Stockholm, Sweden.
  • Vasiliki Kougia
    Department of Computer and Systems Sciences, Stockholm University, Stockholm, Sweden; Faculty of Computer Science, University of Vienna, Vienna, Austria.
  • Panagiotis Papapetrou
    Department of Computer and Systems Sciences, Stockholm University, Sweden. Electronic address: panagiotis@dsv.su.se.