Avatar led interventions in the Metaverse reveal that interpersonal effectiveness can be measured, predicted, and improved.

Journal: Scientific reports
Published Date:

Abstract

Experiential learning has been known to be an engaging and effective modality for personal and professional development. The Metaverse provides ample opportunities for the creation of environments in which such experiential learning can occur. In this work, we introduce a novel interpersonal effectiveness improvement framework (ELAINE) that combines Artificial Intelligence and Virtual Reality to create a highly immersive and efficient learning experience using avatars. We present findings from a study that uses this framework to measure and improve the interpersonal effectiveness of individuals interacting with an avatar. Results reveal that individuals with deficits in their interpersonal effectiveness show a significant improvement (p < 0.02) after multiple interactions with an avatar. The results also reveal that individuals interact naturally with avatars within this framework, and exhibit similar behavioral traits as they would in the real world. We use this as a basis to analyze the underlying audio and video data streams of individuals during these interactions. We extract relevant features from these data and present a machine-learning based approach to predict interpersonal effectiveness during human-avatar conversation. We conclude by discussing the implications of these findings to build beneficial applications for the real world.

Authors

  • Arjun Nagendran
    Mursion Inc., San Francisco, CA, USA. arjun.nagendran@gmail.com.
  • Scott Compton
    Psychiatry and Behavioral Sciences, Duke University, Durham, NC, USA.
  • William C Follette
    Department of Psychology, College of Science, University of Nevada, Reno, NV, USA.
  • Artem Golenchenko
    Mursion Inc., San Francisco, CA, USA.
  • Anna Compton
    Mursion Inc., San Francisco, CA, USA.
  • Jonathan Grizou
    WestCHEM, School of Chemistry, University of Glasgow, Glasgow G12 8QQ, United Kingdom.