Conversations in Content and Context: Can We Teach AI to Chat About Drawings?

Journal: Studies in health technology and informatics
PMID:

Abstract

An innovative chatbot incorporates a drawing tool allowing users to draw pictures that symbolise the nature of their chronic pain. Rather than simply ask 'What did you draw?" what if the chatbot could engage the user to provide insight into symbols and images related to pain and suffering? The system was tested on images that included features of clinical interest in a first step toward a chatbot able to 'see' and discuss visual input. Such a chatbot has the potential for retrospective and prospective applications. *Contains childhood sexual abuse references.

Authors

  • David Ireland
    The Australian E-Health Research Centre, CSIRO, Herston Brisbane.
  • Nicole Andrews
    RECOVER Injury Research Centre, Faculty of Health and Behavioural Sciences, The University of Queensland, Brisbane, QLD, Australia.
  • Dana Bradford
    Australian E-Health Research Centre, CSIRO, Australia.