Capacity of Generative AI to Interpret Human Emotions From Visual and Textual Data: Pilot Evaluation Study.

Journal: JMIR mental health
Published Date: Feb 6, 2024

Abstract

BACKGROUND: Mentalization, which is integral to human cognitive processes, pertains to the interpretation of one's own and others' mental states, including emotions, beliefs, and intentions. With the advent of artificial intelligence (AI) and the prominence of large language models in mental health applications, questions persist about their aptitude in emotional comprehension. The prior iteration of the large language model from OpenAI, ChatGPT-3.5, demonstrated an advanced capacity to interpret emotions from textual data, surpassing human benchmarks. Given the introduction of ChatGPT-4, with its enhanced visual processing capabilities, and considering Google Bard's existing visual functionalities, a rigorous assessment of their proficiency in visual mentalizing is warranted.

Authors

  • Zohar Elyoseph
    The Institute for Research and Development, The Artificial Third, Tel Aviv, Israel.
  • Elad Refoua
    Department of Psychology, Bar-Ilan University, Ramat Gan, Israel.
  • Kfir Asraf
    The Center for Psychobiological Research, Department of Psychology and Educational Counseling, Max Stern Yezreel Valley College, Yezreel Valley, Israel.
  • Maya Lvovsky
    Department of Psychology, The Max Stern Yezreel Valley College, Emek Yezreel, Israel.
  • Yoav Shimoni
    Boston Children's Hospital, Boston, MA, United States.
  • Dorit Hadar-Shoval
    Department of Psychology, The Max Stern Yezreel Valley College, Emek Yezreel, Israel.

Keywords

External Resources

Popular Topics
Recent Journals