Automatically Predicting Perceived Conversation Quality in a Pediatric Sample Enriched for Autism.

Journal: Interspeech
Published Date:

Abstract

Social interaction quality ratings derived from short natural conversations can differentiate children with and without autism at the group level. In this work, we explored conversations between children and an unfamiliar adult who rated their social interaction success on six dimensions. Using hand-crafted acoustic and lexical features, we built different classifiers to predict children's dimensional conversation quality. The best classifier achieved 61% accuracy, which outperformed human raters (49%). Follow-up analyses revealed that a subset of features determined communication quality scores. Additionally, we extracted acoustic features using a pretrained audio transformer and improved our prediction to 68%. This study suggests that automatically predicting conversation quality could be an inexpensive and objective way to monitor intervention progress in children with communication challenges, and could be used to identify intervention targets for improving conversational success.

Authors

  • Yahan Yang
    University of Pennsylvania, Philadelphia, PA.
  • Sunghye Cho
    University of Pennsylvania, Philadelphia, PA.
  • Maxine Covello
    Children's Hospital of Philadelphia, Philadelphia, PA.
  • Azia Knox
    Children's Hospital of Philadelphia, Philadelphia, PA.
  • Osbert Bastani
    University of Pennsylvania, Philadelphia, PA.
  • James Weimer
    Vanderbilt University, Nashville, TN.
  • Edgar Dobriban
    University of Pennsylvania, Philadelphia, PA.
  • Robert Schultz
    University of Pennsylvania, Philadelphia, PA.
  • Insup Lee
    University of Pennsylvania, Philadelphia, PA.
  • Julia Parish-Morris
    University of Pennsylvania, Philadelphia, PA.

Keywords

No keywords available for this article.