Modeling, learning, perception, and control methods for deformable object manipulation.

Journal: Science robotics
Published Date:

Abstract

Perceiving and handling deformable objects is an integral part of everyday life for humans. Automating tasks such as food handling, garment sorting, or assistive dressing requires open problems of modeling, perceiving, planning, and control to be solved. Recent advances in data-driven approaches, together with classical control and planning, can provide viable solutions to these open challenges. In addition, with the development of better simulation environments, we can generate and study scenarios that allow for benchmarking of various approaches and gain better understanding of what theoretical developments need to be made and how practical systems can be implemented and evaluated to provide flexible, scalable, and robust solutions. To this end, we survey more than 100 relevant studies in this area and use it as the basis to discuss open problems. We adopt a learning perspective to unify the discussion over analytical and data-driven approaches, addressing how to use and integrate model priors and task data in perceiving and manipulating a variety of deformable objects.

Authors

  • Hang Yin
    Department of Gastroenterology, Ninth People's Hospital, School of Medicine, Shanghai Jiao Tong University, Shanghai 200011, China.
  • Anastasia Varava
    Robotics, Perception, and Learning (RPL), School of Electrical Engineering and Computer Science, Royal Institute for Technology (KTH), Stockholm, Sweden.
  • Danica Kragic
    Robotics, Perception and Learning (RPL), EECS, Royal Institute for Technology (KTH), Stockholm, Sweden.