Exploring the Impact of the Class on In-the-Wild Human Activity Recognition.

Journal: Sensors (Basel, Switzerland)
Published Date:

Abstract

Monitoring activities of daily living (ADLs) plays an important role in measuring and responding to a person's ability to manage their basic physical needs. Effective recognition systems for monitoring ADLs must successfully recognize naturalistic activities that also realistically occur at infrequent intervals. However, existing systems primarily focus on either recognizing more separable, controlled activity types or are trained on balanced datasets where activities occur more frequently. In our work, we investigate the challenges associated with applying machine learning to an imbalanced dataset collected from a fully environment. This analysis shows that the combination of preprocessing techniques to increase recall and postprocessing techniques to increase precision can result in more desirable models for tasks such as ADL monitoring. In a user-independent evaluation using data, these techniques resulted in a model that achieved an event-based F1-score of over 0.9 for brushing teeth, combing hair, walking, and washing hands. This work tackles fundamental challenges in machine learning that will need to be addressed in order for these systems to be deployed and reliably work in the real world.

Authors

  • Josh Cherian
    Department of Computer Science & Engineering, Texas A&M University, College Station, TX 77843, USA.
  • Samantha Ray
    Department of Computer Science & Engineering, Texas A&M University, College Station, TX 77843, USA.
  • Paul Taele
    Department of Computer Science & Engineering, Texas A&M University, College Station, TX 77843, USA.
  • Jung In Koh
    Department of Computer Science & Engineering, Texas A&M University, College Station, TX 77843, USA.
  • Tracy Hammond
    Department of Computer Science & Engineering, Texas A&M University, College Station, TX 77843, USA.