Learning visual servo policies via planner cloning

05/24/2020
by   Ulrich Viereck, et al.
1

Learning control policies for visual servoing in novel environments is an important problem. However, standard model-free policy learning methods are slow. This paper explores planner cloning: using behavior cloning to learn policies that mimic the behavior of a full-state motion planner in simulation. We propose Penalized Q Cloning (PQC), a new behavior cloning algorithm. We show that it outperforms several baselines and ablations on some challenging problems involving visual servoing in novel environments while avoiding obstacles. Finally, we demonstrate that these policies can be transferred effectively onto a real robotic platform, achieving approximately an 87 success rate both in simulation and on a real robot.

READ FULL TEXT

page 1

page 3

page 5

page 6

page 8

research
11/11/2021

Distilling Motion Planner Augmented Policies into Visual Control Policies for Robot Manipulation

Learning complex manipulation tasks in realistic, obstructed environment...
research
12/03/2018

Mitigating Planner Overfitting in Model-Based Reinforcement Learning

An agent with an inaccurate model of its environment faces a difficult c...
research
03/31/2020

Robotic Table Tennis with Model-Free Reinforcement Learning

We propose a model-free algorithm for learning efficient policies capabl...
research
02/12/2020

Deep compositional robotic planners that follow natural language commands

We demonstrate how a sampling-based robotic planner can be augmented to ...
research
03/05/2018

Learning to Sequence Robot Behaviors for Visual Navigation

Recent literature in the robotics community has focused on learning robo...
research
07/02/2022

Learning Switching Criteria for Sim2Real Transfer of Robotic Fabric Manipulation Policies

Simulation-to-reality transfer has emerged as a popular and highly succe...
research
04/22/2015

Learning of Behavior Trees for Autonomous Agents

Definition of an accurate system model for Automated Planner (AP) is oft...

Please sign up or login with your details

Forgot password? Click here to reset