Motion Similarity Evaluation between Human and a Tri-Co Robot during Real-Time Imitation with a Trajectory Dynamic Time Warping Model.

Journal: Sensors (Basel, Switzerland)
Published Date:

Abstract

Precisely imitating human motions in real-time poses a challenge for the robots due to difference in their physical structures. This paper proposes a human-computer interaction method for remotely manipulating life-size humanoid robots with a new metrics for evaluating motion similarity. First, we establish a motion capture system to acquire the operator's motion data and retarget it to the standard bone model. Secondly, we develop a fast mapping algorithm, by mapping the BVH (BioVision Hierarchy) data collected by the motion capture system to each joint motion angle of the robot to realize the imitated motion control of the humanoid robot. Thirdly, a DTW (Dynamic Time Warping)-based trajectory evaluation method is proposed to quantitatively evaluate the difference between robot trajectory and human motion, and meanwhile, visualization terminals render it more convenient to make comparisons between two different but simultaneous motion systems. We design a complex gesture simulation experiment to verify the feasibility and real-time performance of the control method. The proposed human-in-the-loop imitation control method addresses a prominent non-isostructural retargeting problem between human and robot, enhances robot interaction capability in a more natural way, and improves robot adaptability to uncertain and dynamic environments.

Authors

  • Liang Gong
    Peking Union Medical College, Chinese Academy of Medical Sciences, Beijing, China.
  • Binhao Chen
    School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China.
  • Wenbin Xu
    Nanjing Huazhu Industrial Intelligent Equipment Co., Ltd., Nanjing 211175, China.
  • Chengliang Liu
    School of Mechanical Engineering, Shanghai Jiao Tong University, 800 Dongchuan Road, Shanghai 200240, PR China. Electronic address: chlliu@sjtu.edu.cn.
  • Xudong Li
    School of Cyber Science and Engineering, Sichuan University, China.
  • Zelin Zhao
    School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China.
  • Lujie Zhao
    School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China.