Sim-to-Real Transfer of Robotic Control with Dynamics Randomization

10/18/2017
by   Xue Bin Peng, et al.
0

Simulations are attractive environments for training agents as they provide an abundant source of data and alleviate certain safety concerns during the training process. But the behaviours developed by agents in simulation are often specific to the characteristics of the simulator. Due to modeling error, strategies that are successful in simulation may not transfer to their real world counterparts. In this paper, we demonstrate a simple method to bridge this "reality gap." By randomizing the dynamics of the simulator during training, we are able to develop policies that are capable of adapting to very different dynamics, including ones that differ significantly from the dynamics on which the policies were trained. This adaptivity enables the policies to generalize to the dynamics of the real world without any training on the physical system. Our approach is demonstrated on an object pushing task using a robotic arm. Despite being trained exclusively in simulation, our policies are able to maintain a similar level of performance when deployed on a real robot, reliably moving an object to a desired location from random initial configurations. We explore the impact of various design decisions and show that the resulting policies are robust to significant calibration error.

READ FULL TEXT

page 1

page 4

page 5

research
07/02/2022

Learning Switching Criteria for Sim2Real Transfer of Robotic Fabric Manipulation Policies

Simulation-to-reality transfer has emerged as a popular and highly succe...
research
10/12/2018

Closing the Sim-to-Real Loop: Adapting Simulation Randomization with Real World Experience

We consider the problem of transferring policies to the real world by tr...
research
07/25/2017

Mutual Alignment Transfer Learning

Training robots for operation in the real world is a complex, time consu...
research
04/06/2020

Learning Stabilizing Control Policies for a Tensegrity Hopper with Augmented Random Search

In this paper, we consider tensegrity hopper - a novel tensegrity-based ...
research
05/26/2023

NASimEmu: Network Attack Simulator Emulator for Training Agents Generalizing to Novel Scenarios

Current frameworks for training offensive penetration testing agents wit...
research
06/02/2020

Learning Active Task-Oriented Exploration Policies for Bridging the Sim-to-Real Gap

Training robotic policies in simulation suffers from the sim-to-real gap...
research
09/26/2022

Learning and Deploying Robust Locomotion Policies with Minimal Dynamics Randomization

Training deep reinforcement learning (DRL) locomotion policies often req...

Please sign up or login with your details

Forgot password? Click here to reset