Robot Learning from Randomized Simulations: A Review

11/01/2021
by   Fabio Muratore, et al.
0

The rise of deep learning has caused a paradigm shift in robotics research, favoring methods that require large amounts of data. It is prohibitively expensive to generate such data sets on a physical platform. Therefore, state-of-the-art approaches learn in simulation where data generation is fast as well as inexpensive and subsequently transfer the knowledge to the real robot (sim-to-real). Despite becoming increasingly realistic, all simulators are by construction based on models, hence inevitably imperfect. This raises the question of how simulators can be modified to facilitate learning robot control policies and overcome the mismatch between simulation and reality, often called the 'reality gap'. We provide a comprehensive review of sim-to-real research for robotics, focusing on a technique named 'domain randomization' which is a method for learning from randomized simulations.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 2

page 7

page 10

page 11

page 13

page 15

12/06/2021

Distilled Domain Randomization

Deep reinforcement learning is an effective tool to learn robot control ...
07/10/2019

Assessing Transferability from Simulation to Reality for Reinforcement Learning

Learning robot control policies from physics simulations is of great int...
12/18/2018

Sim-to-Real via Sim-to-Sim: Data-efficient Robotic Grasping via Randomized-to-Canonical Adaptation Networks

Real world data, especially in the domain of robotics, is notoriously co...
12/13/2019

Are We Making Real Progress in Simulated Environments? Measuring the Sim2Real Gap in Embodied Visual Navigation

Does progress in simulation translate to progress in robotics? Specifica...
10/16/2019

Solving Rubik's Cube with a Robot Hand

We demonstrate that models trained only in simulation can be used to sol...
05/08/2020

A Monte Carlo Approach to Closing the Reality Gap

We propose a novel approach to the 'reality gap' problem, i.e., modifyin...
06/04/2019

BayesSim: adaptive domain randomization via probabilistic inference for robotics simulators

We introduce BayesSim, a framework for robotics simulations allowing a f...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.