Real-time human pose estimation and gesture recognition from depth images using superpixels and SVM classifier.

Journal: Sensors (Basel, Switzerland)
Published Date:

Abstract

In this paper, we present human pose estimation and gesture recognition algorithms that use only depth information. The proposed methods are designed to be operated with only a CPU (central processing unit), so that the algorithm can be operated on a low-cost platform, such as an embedded board. The human pose estimation method is based on an SVM (support vector machine) and superpixels without prior knowledge of a human body model. In the gesture recognition method, gestures are recognized from the pose information of a human body. To recognize gestures regardless of motion speed, the proposed method utilizes the keyframe extraction method. Gesture recognition is performed by comparing input keyframes with keyframes in registered gestures. The gesture yielding the smallest comparison error is chosen as a recognized gesture. To prevent recognition of gestures when a person performs a gesture that is not registered, we derive the maximum allowable comparison errors by comparing each registered gesture with the other gestures. We evaluated our method using a dataset that we generated. The experiment results show that our method performs fairly well and is applicable in real environments.

Authors

  • Hanguen Kim
    Urban Robotics Laboratory (URL), Dept. Civil and Environmental Engineering, Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon 305-338, Korea. sskhk05@kaist.ac.kr.
  • Sangwon Lee
    Urban Robotics Laboratory (URL), Dept. Civil and Environmental Engineering, Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon 305-338, Korea. lsw618@gmail.com.
  • Dongsung Lee
    Image & Video Research Group, Samsung S1 Cooperation, 168 S1 Building, Soonhwa-dong,Joong-gu, Seoul 100-773, Korea. dslee.lee@samsung.com.
  • Soonmin Choi
    Image & Video Research Group, Samsung S1 Cooperation, 168 S1 Building, Soonhwa-dong,Joong-gu, Seoul 100-773, Korea. soonmin.choi@samsung.com.
  • Jinsun Ju
    Image & Video Research Group, Samsung S1 Cooperation, 168 S1 Building, Soonhwa-dong,Joong-gu, Seoul 100-773, Korea. jinsun.ju@samsung.com.
  • Hyun Myung
    Urban Robotics Laboratory (URL), Dept. Civil and Environmental Engineering, Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu, Daejeon 305-338, Korea. hmyung@kaist.ac.kr.