Learning Closed-loop Dough Manipulation Using a Differentiable Reset Module

07/11/2022
by   Carl Qi, et al.
0

Deformable object manipulation has many applications such as cooking and laundry folding in our daily lives. Manipulating elastoplastic objects such as dough is particularly challenging because dough lacks a compact state representation and requires contact-rich interactions. We consider the task of flattening a piece of dough into a specific shape from RGB-D images. While the task is seemingly intuitive for humans, there exist local optima for common approaches such as naive trajectory optimization. We propose a novel trajectory optimizer that optimizes through a differentiable "reset" module, transforming a single-stage, fixed-initialization trajectory into a multistage, multi-initialization trajectory where all stages are optimized jointly. We then train a closed-loop policy on the demonstrations generated by our trajectory optimizer. Our policy receives partial point clouds as input, allowing ease of transfer from simulation to the real world. We show that our policy can perform real-world dough manipulation, flattening a ball of dough into a target shape.

READ FULL TEXT

page 1

page 2

page 6

page 7

research
09/16/2023

GenDOM: Generalizable One-shot Deformable Object Manipulation with Parameter-Aware Policy

Due to the inherent uncertainty in their deformability during motion, pr...
research
03/27/2023

DexDeform: Dexterous Deformable Object Manipulation with Human Demonstrations and Differentiable Physics

In this work, we aim to learn dexterous manipulation of deformable objec...
research
06/14/2023

GenORM: Generalizable One-shot Rope Manipulation with Parameter-Aware Policy

Due to the inherent uncertainty in their deformability during motion, pr...
research
03/31/2022

DiffSkill: Skill Abstraction from Differentiable Physics for Deformable Object Manipulations with Tools

We consider the problem of sequential robotic manipulation of deformable...
research
02/23/2022

Let's Handle It: Generalizable Manipulation of Articulated Objects

In this project we present a framework for building generalizable manipu...
research
09/13/2021

UMPNet: Universal Manipulation Policy Network for Articulated Objects

We introduce the Universal Manipulation Policy Network (UMPNet) – a sing...
research
08/06/2018

Liquid Pouring Monitoring via Rich Sensory Inputs

Humans have the amazing ability to perform very subtle manipulation task...

Please sign up or login with your details

Forgot password? Click here to reset