Effective recognition of human lower limb jump locomotion phases based on multi-sensor information fusion and machine learning.

Journal: Medical & biological engineering & computing
Published Date:

Abstract

Jump locomotion is the basic movement of human. However, no thorough research on the recognition of jump sub-phases has been carried so far. This paper aims to use multi-sensor information fusion and machine learning to recognize the human jump phase, which is crucial to the development of exoskeleton that assists jumping. The method of information fusion for sensors including sEMG, IMU, and footswitch sensor is studied. The footswitch signals are filtered by median filter. A processing method of synthesizing Euler angles into phase angle is proposed, which is beneficial to data integration. The jump locomotion is creatively segmented into five phases. The onset and offset of active segment are detected by sample entropy of sEMG and standard deviation of acceleration signal. The features are extracted from analysis windows using multi-sensor information fusion, and the dimension of feature matrix is selected. By comparing the performances of state-of-the-art machine learning classifiers, feature subsets of sEMG, IMU, and footswitch signals are selected from time domain features in a series of analysis window parameters. The average recognition accuracy of sEMG and IMU is 91.76% and 97.68%, respectively. When using the combination of sEMG, IMU, and footswitch signals, the average accuracy is 98.70%, which outperforms the combination of sEMG and IMU (97.97%, p < 0.01). Graphical Abstract The sub-phases of human locomotion are recognized based on multi-sensor information fusion and machine learning method. The feature data of the sub-phases is visualized in 3-dimensional space. The predicted states and the true states in a complete jump are compared along the time axis.

Authors

  • Yanzheng Lu
    School of Mechanical Engineering and Automation, Northeastern University, Shenyang, China.
  • Hong Wang
    Department of Cardiology, Liuzhou Workers' Hospital, The Fourth Affiliated Hospital of Guangxi Medical University, Liuzhou, China.
  • Fo Hu
    Department of Mechanical Engineering and Automation, Northeastern University, Shenyang 110819, China.
  • Bin Zhou
    Department of Oral and Maxillofacial Surgery, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China.
  • Hailong Xi
    Department of Mechanical Engineering and Automation, Northeastern University, Shenyang 110819, China.