Learning Deformable Object Manipulation from Expert Demonstrations

07/20/2022
by   Gautam Salhotra, et al.
0

We present a novel Learning from Demonstration (LfD) method, Deformable Manipulation from Demonstrations (DMfD), to solve deformable manipulation tasks using states or images as inputs, given expert demonstrations. Our method uses demonstrations in three different ways, and balances the trade-off between exploring the environment online and using guidance from experts to explore high dimensional spaces effectively. We test DMfD on a set of representative manipulation tasks for a 1-dimensional rope and a 2-dimensional cloth from the SoftGym suite of tasks, each with state and image observations. Our method exceeds baseline performance by up to 12.9 33.44 randomness. Additionally, we create two challenging environments for folding a 2D cloth using image-based observations, and set a performance benchmark for them. We deploy DMfD on a real robot with a minimal loss in normalized performance during real-world execution compared to simulation ( 6 code is on github.com/uscresl/dmfd

READ FULL TEXT
research
09/16/2023

GenDOM: Generalizable One-shot Deformable Object Manipulation with Parameter-Aware Policy

Due to the inherent uncertainty in their deformability during motion, pr...
research
03/22/2022

Semantic State Estimation in Cloth Manipulation Tasks

Understanding of deformable object manipulations such as textiles is a c...
research
03/20/2023

Learning Foresightful Dense Visual Affordance for Deformable Object Manipulation

Understanding and manipulating deformable objects (e.g., ropes and fabri...
research
06/14/2023

GenORM: Generalizable One-shot Rope Manipulation with Parameter-Aware Policy

Due to the inherent uncertainty in their deformability during motion, pr...
research
10/29/2019

Learning to Manipulate Deformable Objects without Demonstrations

In this paper we tackle the problem of deformable object manipulation th...
research
03/15/2023

PLEX: Making the Most of the Available Data for Robotic Manipulation Pretraining

A rich representation is key to general robotic manipulation, but existi...
research
02/21/2023

Deep Reinforcement Learning Based on Local GNN for Goal-conditioned Deformable Object Rearranging

Object rearranging is one of the most common deformable manipulation tas...

Please sign up or login with your details

Forgot password? Click here to reset