Accelerating Grasp Learning via Pretraining with Coarse Affordance Maps of Objects

05/11/2022
by   Yanxu Hou, et al.
0

Self-supervised grasp learning, i.e., learning to grasp by trial and error, has made great progress. However, it is still time-consuming to train such a model and also a challenge to apply it in practice. This work presents an accelerating method of robotic grasp learning via pretraining with coarse affordance maps of objects to be grasped based on a quite small dataset. A model generated through pre-training is harnessed as an initialization policy to warmly start grasp learning so as to guide a robot to capture more effective rewards at the beginning of training. An object in its coarse affordance map is annotated with a single key point and thereby, the burden of labeling is greatly alleviated. Extensive experiments in simulation and on a real robot are conducted to evaluate the proposed method. The simulation results show that it can significantly accelerate grasp learning by nearly three times over a vanilla Deep Q-Network -based method. Its test on a real UR3 robot shows that it reaches a grasp success rate of 89.5 within about two hours, which is four times faster than its competitor. In addition, it enjoys an outstanding generalization ability to grasp prior-unseen novel objects. It outperforms some existing methods and has the potential to directly apply to a robot for real-world grasp learning tasks.

READ FULL TEXT

page 1

page 3

page 4

page 6

page 8

page 9

research
09/10/2018

Grasp success prediction with quality metrics

Current robotic manipulation requires reliable methods to predict whethe...
research
06/10/2023

On Robot Grasp Learning Using Equivariant Models

Real-world grasp detection is challenging due to the stochasticity in gr...
research
10/21/2020

A Coarse-To-Fine (C2F) Representation for End-To-End 6-DoF Grasp Detection

We proposed an end-to-end grasp detection network, Grasp Detection Netwo...
research
06/30/2022

EfficientGrasp: A Unified Data-Efficient Learning to Grasp Method for Multi-fingered Robot Hands

Autonomous grasping of novel objects that are previously unseen to a rob...
research
12/17/2020

Multi-FinGAN: Generative Coarse-To-Fine Sampling of Multi-Finger Grasps

While there exists a large number of methods for manipulating rigid obje...
research
06/07/2019

Object-Agnostic Suction Grasp Affordance Detection in Dense Cluster Using Self-Supervised Learning.docx

In this paper we study grasp problem in dense cluster, a challenging tas...
research
03/28/2023

DefGraspNets: Grasp Planning on 3D Fields with Graph Neural Nets

Robotic grasping of 3D deformable objects is critical for real-world app...

Please sign up or login with your details

Forgot password? Click here to reset