Beyond Pick-and-Place: Tackling Robotic Stacking of Diverse Shapes

10/12/2021
by   Alex X. Lee, et al.
0

We study the problem of robotic stacking with objects of complex geometry. We propose a challenging and diverse set of such objects that was carefully designed to require strategies beyond a simple "pick-and-place" solution. Our method is a reinforcement learning (RL) approach combined with vision-based interactive policy distillation and simulation-to-reality transfer. Our learned policies can efficiently handle multiple object combinations in the real world and exhibit a large variety of stacking skills. In a large experimental study, we investigate what choices matter for learning such general vision-based agents in simulation, and what affects optimal transfer to the real robot. We then leverage data collected by such policies and improve upon them with offline RL. A video and a blog post of our work are provided as supplementary material.

READ FULL TEXT

page 16

page 19

page 24

page 27

page 32

page 39

page 41

page 42

research
05/06/2022

How to Spend Your Robot Time: Bridging Kickstarting and Offline Reinforcement Learning for Vision-based Robotic Manipulation

Reinforcement learning (RL) has been shown to be effective at learning c...
research
10/25/2022

DeXtreme: Transfer of Agile In-hand Manipulation from Simulation to Reality

Recent work has demonstrated the ability of deep reinforcement learning ...
research
09/11/2023

Robot Parkour Learning

Parkour is a grand challenge for legged locomotion that requires robots ...
research
09/17/2019

Adversarial Feature Training for Generalizable Robotic Visuomotor Control

Deep reinforcement learning (RL) has enabled training action-selection p...
research
05/04/2023

Learning Generalizable Pivoting Skills

The skill of pivoting an object with a robotic system is challenging for...
research
08/07/2017

GPLAC: Generalizing Vision-Based Robotic Skills using Weakly Labeled Images

We tackle the problem of learning robotic sensorimotor control policies ...
research
06/16/2020

RL-CycleGAN: Reinforcement Learning Aware Simulation-To-Real

Deep neural network based reinforcement learning (RL) can learn appropri...

Please sign up or login with your details

Forgot password? Click here to reset