Eye Gaze Based 3D Triangulation for Robotic Bionic Eyes.

Journal: Sensors (Basel, Switzerland)
PMID:

Abstract

Three-dimensional (3D) triangulation based on active binocular vision has increasing amounts of applications in computer vision and robotics. An active binocular vision system with non-fixed cameras needs to calibrate the stereo extrinsic parameters online to perform 3D triangulation. However, the accuracy of stereo extrinsic parameters and disparity have a significant impact on 3D triangulation precision. We propose a novel eye gaze based 3D triangulation method that does not use stereo extrinsic parameters directly in order to reduce the impact. Instead, we drive both cameras to gaze at a 3D spatial point at the optical center through visual servoing. Subsequently, we can obtain the 3D coordinates of through the intersection of the two optical axes of both cameras. We have performed experiments to compare with previous disparity based work, named the integrated two-pose calibration (ITPC) method, using our robotic bionic eyes. The experiments show that our method achieves comparable results with ITPC.

Authors

  • Di Fan
    School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China.
  • Yanyang Liu
    AIPARK, Zhangjiakou 075000, China.
  • Xiaopeng Chen
    School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China.
  • Fei Meng
    Beijing Advanced Innovation Center for Intelligent Robots and Systems, Beijing Institute of Technology, Beijing 100081, China.
  • Xilong Liu
    Department of Radiology, Nanfang Hospital, Southern Medical University, Guangzhou, 510515, Guangdong, China.
  • Zakir Ullah
    Beijing Advanced Innovation Center for Intelligent Robots and Systems, Beijing Institute of Technology, Beijing 100081, China.
  • Wei Cheng
    Department of Dental Implantology, Nanjing Stomatological Hospital, Affiliated Hospital of Medical School, Institute of Stomatology, Nanjing University, Nanjing, China.
  • Yunhui Liu
  • Qiang Huang
    Department of Orthopedics, West China Hospital, Sichuan University, Chengdu Sichuan, 610041, P.R.China.