Leveraging Symmetries in Pick and Place

08/15/2023
by   Haojie Huang, et al.
0

Robotic pick and place tasks are symmetric under translations and rotations of both the object to be picked and the desired place pose. For example, if the pick object is rotated or translated, then the optimal pick action should also rotate or translate. The same is true for the place pose; if the desired place pose changes, then the place action should also transform accordingly. A recently proposed pick and place framework known as Transporter Net captures some of these symmetries, but not all. This paper analytically studies the symmetries present in planar robotic pick and place and proposes a method of incorporating equivariant neural models into Transporter Net in a way that captures all symmetries. The new model, which we call Equivariant Transporter Net, is equivariant to both pick and place symmetries and can immediately generalize pick and place knowledge to different pick and place poses. We evaluate the new model empirically and show that it is much more sample efficient than the non-symmetric version, resulting in a system that can imitate demonstrated pick and place behavior using very few human demonstrations on a variety of imitation learning tasks.

READ FULL TEXT

page 2

page 5

page 10

page 11

page 14

research
02/18/2022

Equivariant Transporter Network

Transporter Net is a recently proposed framework for pick and place that...
research
08/25/2020

Logic Signed Petri Net

In this paper,the authors show the versatility of the Signed Petri Net (...
research
09/18/2021

Learning to Regrasp by Learning to Place

In this paper, we explore whether a robot can learn to regrasp a diverse...
research
03/21/2017

One-Shot Imitation Learning

Imitation learning has been commonly applied to solve different tasks in...
research
04/07/2022

Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scale

We present a large-scale study of imitating human demonstrations on task...
research
10/28/2021

Equivariant Q Learning in Spatial Action Spaces

Recently, a variety of new equivariant neural network model architecture...
research
02/17/2023

Train What You Know – Precise Pick-and-Place with Transporter Networks

Precise pick-and-place is essential in robotic applications. To this end...

Please sign up or login with your details

Forgot password? Click here to reset