The Ingredients of Real-World Robotic Reinforcement Learning

by   Henry Zhu, et al.

The success of reinforcement learning for real world robotics has been, in many cases limited to instrumented laboratory scenarios, often requiring arduous human effort and oversight to enable continuous learning. In this work, we discuss the elements that are needed for a robotic learning system that can continually and autonomously improve with data collected in the real world. We propose a particular instantiation of such a system, using dexterous manipulation as our case study. Subsequently, we investigate a number of challenges that come up when learning without instrumentation. In such settings, learning must be feasible without manually designed resets, using only on-board perception, and without hand-engineered reward functions. We propose simple and scalable solutions to these challenges, and then demonstrate the efficacy of our proposed system on a set of dexterous robotic manipulation tasks, providing an in-depth analysis of the challenges associated with this learning paradigm. We demonstrate that our complete system can learn without any human intervention, acquiring a variety of vision-based skills with a real-world three-fingered hand. Results and videos can be found at



There are no comments yet.


page 3

page 8

page 10

page 16

page 17

page 18

page 19

page 20


DexPilot: Vision Based Teleoperation of Dexterous Robotic Hand-Arm System

Teleoperation offers the possibility of imparting robotic systems with s...

A Framework for Efficient Robotic Manipulation

Data-efficient learning of manipulation policies from visual observation...

Dexterous Manipulation with Deep Reinforcement Learning: Efficient, General, and Low-Cost

Dexterous multi-fingered robotic hands can perform a wide range of manip...

Beyond Pick-and-Place: Tackling Robotic Stacking of Diverse Shapes

We study the problem of robotic stacking with objects of complex geometr...

Dual-Arm Adversarial Robot Learning

Robot learning is a very promising topic for the future of automation an...

Machine Learning for Robotic Manipulation

The past decade has witnessed the tremendous successes of machine learni...

Quantifying the Reality Gap in Robotic Manipulation Tasks

We quantify the accuracy of various simulators compared to a real world ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.