Parareal with a Learned Coarse Model for Robotic Manipulation

12/12/2019
by   Wisdom Agboh, et al.
0

A key component of many robotics model-based planning and control algorithms is physics predictions, that is, forecasting a sequence of states given an initial state and a sequence of controls. This process is slow and a major computational bottleneck for robotics planning algorithms. Parallel-in-time integration methods can help to leverage parallel computing to accelerate physics predictions and thus planning. The Parareal algorithm iterates between a coarse serial integrator and a fine parallel integrator. A key challenge is to devise a coarse level model that is computationally cheap but accurate enough for Parareal to converge quickly. Here, we investigate the use of a deep neural network physics model as a coarse model for Parareal in the context of robotic manipulation. In simulated experiments using the physics engine Mujoco as fine propagator we show that the learned coarse model leads to faster Parareal convergence than a coarse physics-based model. We further show that the learned coarse model allows to apply Parareal to scenarios with multiple objects, where the physics-based coarse model is not applicable. Finally, We conduct experiments on a real robot and show that Parareal predictions are close to real-world physics predictions for robotic pushing of multiple objects. Some real robot manipulation plans using Parareal can be found at https://www.youtube.com/watch?v=wCh2o1rf-gA .

READ FULL TEXT

page 3

page 8

research
03/20/2019

Combining Coarse and Fine Physics for Manipulation using Parallel-in-Time Integration

We present a method for fast and accurate physics-based predictions duri...
research
03/07/2023

Parareal with a physics-informed neural network as coarse propagator

Parallel-in-time algorithms provide an additional layer of concurrency f...
research
03/17/2021

An Inextensible Model for Robotic Simulations of Textiles

We introduce a new isometric strain model for the study of the dynamics ...
research
10/24/2017

Model Identification via Physics Engines for Improved Policy Search

This paper presents a practical approach for identifying unknown mechani...
research
04/26/2022

Coarse-to-fine Q-attention with Tree Expansion

Coarse-to-fine Q-attention enables sample-efficient robot manipulation b...
research
03/15/2020

Planning with Selective Physics-based Simulation for Manipulation Among Movable Objects

Use of physics-based simulation as a planning model enables a planner to...
research
09/18/2019

An Adaptive Parareal Algorithm

In this paper, we consider the problem of accelerating the numerical sim...

Please sign up or login with your details

Forgot password? Click here to reset