Baseball Player Behavior Classification System Using Long Short-Term Memory with Multimodal Features.

Journal: Sensors (Basel, Switzerland)
PMID:

Abstract

In this paper, a preliminary baseball player behavior classification system is proposed. By using multiple IoT sensors and cameras, the proposed method accurately recognizes many of baseball players' behaviors by analyzing signals from heterogeneous sensors. The contribution of this paper is threefold: (i) signals from a depth camera and from multiple inertial sensors are obtained and segmented, (ii) the time-variant skeleton vector projection from the depth camera and the statistical features extracted from the inertial sensors are used as features, and (iii) a deep learning-based scheme is proposed for training behavior classifiers. The experimental results demonstrate that the proposed deep learning behavior system achieves an accuracy of greater than 95% compared to the proposed dataset.

Authors

  • Shih-Wei Sun
    Department of New Media Art, Taipei National University of the Arts, Taipei 112, Taiwan. swsun@newmedia.tnua.edu.tw.
  • Ting-Chen Mou
    Department of Communication Engineering, National Central University, Taoyuan 320, Taiwan. tcmou.vaplab@gmail.com.
  • Chih-Chieh Fang
    Graduate Institute of Dance Theory, Taipei National University of the Arts, Taipei 112, Taiwan. m10446017@dance.tnua.edu.tw.
  • Pao-Chi Chang
  • Kai-Lung Hua
    Department of Computer Science and Information Engineering, National Taiwan University of Science and Technology, Taipei 106, Taiwan. hua@mail.ntust.edu.tw.
  • Huang-Chia Shih
    Department of Electrical Engineering, Yuan Ze University, Taoyuan 320, Taiwan. hcshih@saturn.yzu.edu.tw.