Follow the Gradient: Crossing the Reality Gap using Differentiable Physics (RealityGrad)

09/10/2021
by   Jack Collins, et al.
0

We propose a novel iterative approach for crossing the reality gap that utilises live robot rollouts and differentiable physics. Our method, RealityGrad, demonstrates for the first time, an efficient sim2real transfer in combination with a real2sim model optimisation for closing the reality gap. Differentiable physics has become an alluring alternative to classical rigid-body simulation due to the current culmination of automatic differentiation libraries, compute and non-linear optimisation libraries. Our method builds on this progress and employs differentiable physics for efficient trajectory optimisation. We demonstrate RealitGrad on a dynamic control task for a serial link robot manipulator and present results that show its efficiency and ability to quickly improve not just the robot's performance in real world tasks but also enhance the simulation model for future tasks. One iteration of RealityGrad takes less than 22 minutes on a desktop computer while reducing the error by 2/3, making it efficient compared to other sim2real methods in both compute and time. Our methodology and application of differentiable physics establishes a promising approach for crossing the reality gap and has great potential for scaling to complex environments.

READ FULL TEXT

page 1

page 5

research
02/22/2022

Differentiable and Learnable Robot Models

Building differentiable simulations of physical processes has recently r...
research
03/03/2020

Traversing the Reality Gap via Simulator Tuning

The large demand for simulated data has made the reality gap a problem o...
research
02/20/2022

Real-time Model Predictive Control and System Identification Using Differentiable Physics Simulation

Developing robot controllers in a simulated environment is advantageous ...
research
05/08/2020

A Monte Carlo Approach to Closing the Reality Gap

We propose a novel approach to the 'reality gap' problem, i.e., modifyin...
research
07/25/2019

TuneNet: One-Shot Residual Tuning for System Identification and Sim-to-Real Robot Task Transfer

As researchers teach robots to perform more and more complex tasks, the ...
research
11/22/2021

Bridging the reality gap in quantum devices with physics-aware machine learning

The discrepancies between reality and simulation impede the optimisation...
research
06/24/2021

Brax – A Differentiable Physics Engine for Large Scale Rigid Body Simulation

We present Brax, an open source library for rigid body simulation with a...

Please sign up or login with your details

Forgot password? Click here to reset