Sim-to-real Transfer of Visuo-motor Policies for Reaching in Clutter: Domain Randomization and Adaptation with Modular Networks

09/18/2017
by   Fangyi Zhang, et al.
0

A modular method is proposed to learn and transfer visuo-motor policies from simulation to the real world in an efficient manner by combining domain randomization and adaptation. The feasibility of the approach is demonstrated in a table-top object reaching task where a 7 DoF arm is controlled in velocity mode to reach a blue cuboid in clutter through visual observations. The learned visuo-motor policies are robust to novel (not seen in training) objects in clutter and even a moving target, achieving a 93.3 control accuracy.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

research
06/02/2019

Learning Domain Randomization Distributions for Transfer of Locomotion Policies

Domain randomization (DR) is a successful technique for learning robust ...
research
03/11/2019

Sim-to-(Multi)-Real: Transfer of Low-Level Robust Control Policies to Multiple Quadrotors

Quadrotor stabilizing controllers often require careful, model-specific ...
research
10/14/2022

Learning to Autonomously Reach Objects with NICO and Grow-When-Required Networks

The act of reaching for an object is a fundamental yet complex skill for...
research
10/07/2019

Force Field Generalization and the Internal Representation of Motor Learning

When learning a new motor behavior, e.g. reaching in a force field, the ...
research
10/21/2016

Modular Deep Q Networks for Sim-to-real Transfer of Visuo-motor Policies

While deep learning has had significant successes in computer vision tha...
research
05/15/2017

Tuning Modular Networks with Weighted Losses for Hand-Eye Coordination

This paper introduces an end-to-end fine-tuning method to improve hand-e...
research
06/21/2017

Structure Learning in Motor Control:A Deep Reinforcement Learning Model

Motor adaptation displays a structure-learning effect: adaptation to a n...

Please sign up or login with your details

Forgot password? Click here to reset