Recognition of Fine-Grained Walking Patterns Using a Smartwatch with Deep Attentive Neural Networks.

Journal: Sensors (Basel, Switzerland)
Published Date:

Abstract

Generally, people do various things while walking. For example, people frequently walk while looking at their smartphones. Sometimes we walk differently than usual; for example, when walking on ice or snow, we tend to waddle. Understanding walking patterns could provide users with contextual information tailored to the current situation. To formulate this as a machine-learning problem, we defined 18 different everyday walking styles. Noting that walking strategies significantly affect the spatiotemporal features of hand motions, e.g., the speed and intensity of the swinging arm, we propose a smartwatch-based wearable system that can recognize these predefined walking styles. We developed a wearable system, suitable for use with a commercial smartwatch, that can capture hand motions in the form of multivariate timeseries (MTS) signals. Then, we employed a set of machine learning algorithms, including feature-based and recent deep learning algorithms, to learn the MTS data in a supervised fashion. Experimental results demonstrated that, with recent deep learning algorithms, the proposed approach successfully recognized a variety of walking patterns, using the smartwatch measurements. We analyzed the results with recent attention-based recurrent neural networks to understand the relative contributions of the MTS signals in the classification process.

Authors

  • Hyejoo Kim
    Machine Learning Systems Lab., College of Sports Science, Sungkyunkwan University, Suwon 16419, Korea.
  • Hyeon-Joo Kim
    Machine Learning Systems Lab., College of Sports Science, Sungkyunkwan University, Suwon 16419, Korea.
  • Jinyoon Park
    Machine Learning Systems Lab., College of Sports Science, Sungkyunkwan University, Suwon 16419, Korea.
  • Jeh-Kwang Ryu
    Department of Physical Education, College of Education, Dongguk University, Seoul 04620, Korea.
  • Seung-Chan Kim
    Department of Statistics, Pukyong National University, Busan, Republic of Korea.