Facial Emotion Recognition of 16 Distinct Emotions From Smartphone Videos: Comparative Study of Machine Learning and Human Performance.

Journal: Journal of medical Internet research
Published Date:

Abstract

BACKGROUND: The development of automatic emotion recognition models from smartphone videos is a crucial step toward the dissemination of psychotherapeutic app interventions that encourage emotional expressions. Existing models focus mainly on the 6 basic emotions while neglecting other therapeutically relevant emotions. To support this research, we introduce the novel Stress Reduction Training Through the Recognition of Emotions Wizard-of-Oz (STREs WoZ) dataset, which contains facial videos of 16 distinct, therapeutically relevant emotions.

Authors

  • Marie Keinert
    Department of Clinical Psychology and Psychotherapy, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany.
  • Simon Pistrosch
    Chair of Health Informatics, Technical University of Munich, Munich, Germany.
  • Adria Mallol-Ragolta
    Chair of Health Informatics, Technical University of Munich, Munich, Germany.
  • Björn W Schuller
    GLAM - the Group on Language, Audio, & Music, Imperial College London, London, United Kingdom.
  • Matthias Berking
    Department for Clinical Psychology and Psychotherapy, Friedrich-Alexander-Universität Erlangen-Nürnberg, 91052 Erlangen, Germany.