Grasping detection of dual manipulators based on Markov decision process with neural network.

Journal: Neural networks : the official journal of the International Neural Network Society
Published Date:

Abstract

With the development of artificial intelligence, robots are widely used in various fields, grasping detection has been the focus of intelligent robot research. A dual manipulator grasping detection model based on Markov decision process is proposed to realize the stable grasping with complex multiple objects in this paper. Based on the principle of Markov decision process, the cross entropy convolutional neural network and full convolutional neural network are used to parameterize the grasping detection model of dual manipulators which are two-finger manipulator and vacuum sucker manipulator for multi-objective unknown objects. The data set generated in the simulated environment is used to train the two grasping detection networks. By comparing the grasping quality of the detection network output the best grasping by the two grasping methods, the network with better detection effect corresponding to the two grasping methods of two-finger and vacuum sucker is determined, and the dual manipulator grasping detection model is constructed in this paper. Robot grasping experiments are carried out, and the experimental results show that the proposed dual manipulator grasping detection method achieves 90.6% success rate, which is much higher than the other groups of experiments. The feasibility and superiority of the dual manipulator grasping detection method based on Markov decision process are verified.

Authors

  • Juntong Yun
    Key Laboratory of Metallurgical Equipment and Control Technology, Ministry of Education, Wuhan University of Science and Technology, Wuhan 430081, China.
  • Du Jiang
    Research Center for Biomimetic Robot and Intelligent Measurement and Control, Wuhan University of science and Technology, Wuhan 430081, China; Hubei Key Laboratory of Mechanical Transmission and Manufacturing Engineering, Wuhan University of science and Technology, Wuhan 430081, China; Hubei Longzhong Laboratory, Xiangyang 441000, Hubei, China. Electronic address: jiangdu@wust.edu.cn.
  • Li Huang
    National Research Center for Resettlement (NRCR), Hohai University, 1 Xikang Road, Nanjing 210098, China. lily8214@hhu.edu.cn.
  • Bo Tao
    Department of Radiology, the Center for Medical Imaging, West China Hospital of Sichuan University, China.
  • Shangchun Liao
    Hubei Longzhong Laboratory, Xiangyang 441000, Hubei, China.
  • Ying Liu
    The First School of Clinical Medicine, Lanzhou University, Lanzhou, China.
  • Xin Liu
    Peking University Institute of Advanced Agricultural Sciences, Shandong Laboratory of Advanced Agricultural Sciences, Weifang, Shandong, China.
  • Gongfa Li
    Key Laboratory of Metallurgical Equipment and Control Technology of Ministry of Education, Wuhan University of Science and Technology, Wuhan 430081, China; Research Center for Biomimetic Robot and Intelligent Measurement and Control, Wuhan University of science and Technology, Wuhan 430081, China; Hubei Longzhong Laboratory, Xiangyang 441000, Hubei, China. Electronic address: ligongfa@wust.edu.cn.
  • Disi Chen
    Robotics and machine vision, Bristol Robotics Lab, University of the West of England, United Kingdom.
  • Baojia Chen
    Hubei Key Laboratory of Hydroelectric Machinery Design and Maintenance, China Three Gorges University, Yichang 443002, China.