A soft artificial muscle driven robot with reinforcement learning.

Journal: Scientific reports
Published Date:

Abstract

Soft robots driven by stimuli-responsive materials have their own unique advantages over traditional rigid robots such as large actuation, light weight, good flexibility and biocompatibility. However, the large actuation of soft robots inherently co-exists with difficulty in control with high precision. This article presents a soft artificial muscle driven robot mimicking cuttlefish with a fully integrated on-board system including power supply and wireless communication system. Without any motors, the movements of the cuttlefish robot are solely actuated by dielectric elastomer which exhibits muscle-like properties including large deformation and high energy density. Reinforcement learning is used to optimize the control strategy of the cuttlefish robot instead of manual adjustment. From scratch, the swimming speed of the robot is enhanced by 91% with reinforcement learning, reaching to 21 mm/s (0.38 body length per second). The design principle behind the structure and the control of the robot can be potentially useful in guiding device designs for demanding applications such as flexible devices and soft robots.

Authors

  • Tao Yang
    The First Clinical Medical College, The Affiliated People's Hospital of Fujian University of Traditional Chinese Medicine, Fuzhou, Fujian, China.
  • Youhua Xiao
    Department of Chemical and Biological Engineering, Zhejiang University, Hangzhou, 310027, China.
  • Zhen Zhang
    School of Pharmacy, Jining Medical University, Rizhao, Shandong, China.
  • Yiming Liang
    Department of Engineering Mechanics, Zhejiang University, Hangzhou, 310027, China.
  • Guorui Li
    Department of Engineering Mechanics, Zhejiang University, Hangzhou, 310027, China.
  • Mingqi Zhang
    Department of Engineering Mechanics, Zhejiang University, Hangzhou, 310027, China.
  • Shijian Li
    Department of Computer Science, Zhejiang University, Hangzhou, 310027, China.
  • Tuck-Whye Wong
    Advanced Membrane Technology Research Centre, Universiti Tekonologi Malaysia, Johor, 81310, Malaysia.
  • Yong Wang
    State Key Laboratory of Chemical Biology and Drug Discovery, Department of Applied Biology and Chemical Technology, The Hong Kong Polytechnic University Hunghom Kowloon Hong Kong P. R. China kwok-yin.wong@polyu.edu.hk.
  • Tiefeng Li
    State Key Laboratory of Fluid Power and Mechatronic Systems, Zhejiang University, Hangzhou, 310027, China. litiefeng@zju.edu.cn.
  • Zhilong Huang
    State Key Laboratory of Fluid Power and Mechatronic Systems, Zhejiang University, Hangzhou, 310027, China.