Considering patient safety in autonomous e-mental health systems - detecting risk situations and referring patients back to human care.

Journal: BMC medical informatics and decision making
Published Date:

Abstract

BACKGROUND: Digital health interventions can fill gaps in mental healthcare provision. However, autonomous e-mental health (AEMH) systems also present challenges for effective risk management. To balance autonomy and safety, AEMH systems need to detect risk situations and act on these appropriately. One option is sending automatic alerts to carers, but such 'auto-referral' could lead to missed cases or false alerts. Requiring users to actively self-refer offers an alternative, but this can also be risky as it relies on their motivation to do so. This study set out with two objectives. Firstly, to develop guidelines for risk detection and auto-referral systems. Secondly, to understand how persuasive techniques, mediated by a virtual agent, can facilitate self-referral.

Authors

  • Myrthe L Tielman
    Department of Interactive Intelligence, Delft University of Technology, van Mourik Broekmanweg 6, 2628 XE, Delft, The Netherlands. m.l.tielman@tudelft.nl.
  • Mark A Neerincx
    TNO Leiden, Schipholweg 77, 2316 ZL, Leiden, The Netherlands. Electronic address: mark.neerincx@tno.nl.
  • Claudia Pagliari
    Edinburgh University, Edinburgh, UK.
  • Albert Rizzo
    USC Institute of Creative Technologies, Playa Vista, California, USA.
  • Willem-Paul Brinkman
    Department of Interactive Intelligence, Delft University of Technology, van Mourik Broekmanweg 6, 2628 XE, Delft, The Netherlands.