Rethinking Optimization with Differentiable Simulation from a Global Perspective

06/28/2022
by   Rika Antonova, et al.
0

Differentiable simulation is a promising toolkit for fast gradient-based policy optimization and system identification. However, existing approaches to differentiable simulation have largely tackled scenarios where obtaining smooth gradients has been relatively easy, such as systems with mostly smooth dynamics. In this work, we study the challenges that differentiable simulation presents when it is not feasible to expect that a single descent reaches a global optimum, which is often a problem in contact-rich scenarios. We analyze the optimization landscapes of diverse scenarios that contain both rigid bodies and deformable objects. In dynamic environments with highly deformable objects and fluids, differentiable simulators produce rugged landscapes with nonetheless useful gradients in some parts of the space. We propose a method that combines Bayesian optimization with semi-local 'leaps' to obtain a global search method that can use gradients effectively, while also maintaining robust performance in regions with noisy gradients. We show that our approach outperforms several gradient-based and gradient-free baselines on an extensive set of experiments in simulation, and also validate the method using experiments with a real robot and deformables. Videos and supplementary materials are available at https://tinyurl.com/globdiff

READ FULL TEXT

page 7

page 8

page 11

page 12

page 13

page 15

page 16

page 17

research
07/02/2020

ADD: Analytically Differentiable Dynamics for Multi-Body Systems with Frictional Contact

We present a differentiable dynamics solver that is able to handle frict...
research
07/08/2022

Differentiable Physics Simulations with Contacts: Do They Have Correct Gradients w.r.t. Position, Velocity and Control?

In recent years, an increasing amount of work has focused on differentia...
research
07/12/2020

Augmenting Differentiable Simulators with Neural Networks to Close the Sim2Real Gap

We present a differentiable simulation architecture for articulated rigi...
research
05/22/2018

Neural Generative Models for Global Optimization with Gradients

The aim of global optimization is to find the global optimum of arbitrar...
research
04/07/2022

DiffCloud: Real-to-Sim from Point Clouds with Differentiable Simulation and Rendering of Deformable Objects

Research in manipulation of deformable objects is typically conducted on...
research
07/15/2021

An End-to-End Differentiable Framework for Contact-Aware Robot Design

The current dominant paradigm for robotic manipulation involves two sepa...
research
07/20/2022

Differentiable Agent-based Epidemiology

Mechanistic simulators are an indispensable tool for epidemiology to exp...

Please sign up or login with your details

Forgot password? Click here to reset