Exploring Orientation Invariant Heuristic Features with Variant Window Length of 1D-CNN-LSTM in Human Activity Recognition.

Journal: Biosensors
Published Date:

Abstract

Many studies have explored divergent deep neural networks in human activity recognition (HAR) using a single accelerometer sensor. Multiple types of deep neural networks, such as convolutional neural networks (CNN), long short-term memory (LSTM), or their hybridization (CNN-LSTM), have been implemented. However, the sensor orientation problem poses challenges in HAR, and the length of windows as inputs for the deep neural networks has mostly been adopted arbitrarily. This paper explores the effect of window lengths with orientation invariant heuristic features on the performance of 1D-CNN-LSTM in recognizing six human activities; sitting, lying, walking and running at three different speeds using data from an accelerometer sensor encapsulated into a smartphone. Forty-two participants performed the six mentioned activities by keeping smartphones in their pants pockets with arbitrary orientation. We conducted an inter-participant evaluation using 1D-CNN-LSTM architecture. We found that the average accuracy of the classifier was saturated to 80 ± 8.07% for window lengths greater than 65 using only four selected simple orientation invariant heuristic features. In addition, precision, recall and 1-measure in recognizing stationary activities such as sitting and lying decreased with increment of window length, whereas we encountered an increment in recognizing the non-stationary activities.

Authors

  • Arnab Barua
    Academy for Innovation, Design and Technology, Mälardalens University, Västerås, Sweden.
  • Daniel Fuller
    School of Human Kinetics and Recreation, Physical Education Building, Memorial University, St. John's, NL, A1C 5S7, Canada. Electronic address: dfuller@mun.ca.
  • Sumayyah Musa
    School of Human Kinetics and Recreation, Memorial University of Newfoundland, St. John's, NL A1C 5S7, Canada.
  • Xianta Jiang
    Department of Computer Science, Memorial University of Newfoundland, St. John's, NL A1B 3X5, Canada.