Personalized Activity Recognition with Deep Triplet Embeddings.

Journal: Sensors (Basel, Switzerland)
Published Date:

Abstract

A significant challenge for a supervised learning approach to inertial human activity recognition is the heterogeneity of data generated by individual users, resulting in very poor performance for some subjects. We present an approach to personalized activity recognition based on deep feature representation derived from a convolutional neural network (CNN). We experiment with both categorical cross-entropy loss and triplet loss for training, and describe a novel loss function based on subject triplets. We evaluate these methods on three publicly available inertial human activity recognition datasets (MHEALTH, WISDM, and SPAR) comparing classification accuracy, out-of-distribution activity detection, and generalization to new activity classes. The proposed triplet algorithm achieved an average 96.7% classification accuracy across tested datasets versus the 87.5% achieved by the baseline CNN algorithm. We demonstrate that personalized algorithms, and, in particular, the proposed novel triplet loss algorithms, are more robust to inter-subject variability and thus exhibit better performance on classification and out-of-distribution detection tasks.

Authors

  • David Burns
    Division of Orthopaedic Surgery, Department of Surgery, University of Toronto, Toronto, ON M5S 1A1, Canada.
  • Philip Boyer
    Orthopaedic Biomechanics Lab, Holland Bone and Joint Program, Sunnybrook Research Institute, Toronto, ON M4N 3M5, Canada.
  • Colin Arrowsmith
    Orthopaedic Biomechanics Laboratory, Holland Bone and Joint Program, Sunnybrook Research Institute, Toronto, ON M4N 3M5, Canada.
  • Cari Whyne
    Division of Orthopaedic Surgery, University of Toronto, Toronto, ON, Canada; Granovsky Gluskin Division of Orthopaedics, Mount Sinai Hospital, Toronto, ON, Canada; Division of Orthopaedic Surgery, Sunnybrook Health Science Centre, Toronto, ON, Canada.