Benchmarking Deformable Object Manipulation with Differentiable Physics

10/24/2022
by   Siwei Chen, et al.
0

Deformable Object Manipulation (DOM) is of significant importance to both daily and industrial applications. Recent successes in differentiable physics simulators allow learning algorithms to train a policy with analytic gradients through environment dynamics, which significantly facilitates the development of DOM algorithms. However, existing DOM benchmarks are either single-object-based or non-differentiable. This leaves the questions of 1) how a task-specific algorithm performs on other tasks and 2) how a differentiable-physics-based algorithm compares with the non-differentiable ones in general. In this work, we present DaXBench, a differentiable DOM benchmark with a wide object and task coverage. DaXBench includes 9 challenging high-fidelity simulated tasks, covering rope, cloth, and liquid manipulation with various difficulty levels. To better understand the performance of general algorithms on different DOM tasks, we conduct comprehensive experiments over representative DOM methods, ranging from planning to imitation learning and reinforcement learning. In addition, we provide careful empirical studies of existing decision-making algorithms based on differentiable physics, and discuss their limitations, as well as potential future directions.

READ FULL TEXT

page 4

page 9

page 13

research
06/10/2022

Imitation Learning via Differentiable Physics

Existing imitation learning (IL) methods such as inverse reinforcement l...
research
03/31/2022

DiffSkill: Skill Abstraction from Differentiable Physics for Deformable Object Manipulations with Tools

We consider the problem of sequential robotic manipulation of deformable...
research
03/27/2023

DexDeform: Dexterous Deformable Object Manipulation with Human Demonstrations and Differentiable Physics

In this work, we aim to learn dexterous manipulation of deformable objec...
research
03/06/2022

Leveraging Reward Gradients For Reinforcement Learning in Differentiable Physics Simulations

In recent years, fully differentiable rigid body physics simulators have...
research
09/20/2023

Achieving Autonomous Cloth Manipulation with Optimal Control via Differentiable Physics-Aware Regularization and Safety Constraints

Cloth manipulation is a category of deformable object manipulation of gr...
research
04/07/2021

PlasticineLab: A Soft-Body Manipulation Benchmark with Differentiable Physics

Simulated virtual environments serve as one of the main driving forces b...
research
04/29/2022

GenDR: A Generalized Differentiable Renderer

In this work, we present and study a generalized family of differentiabl...

Please sign up or login with your details

Forgot password? Click here to reset