6-DoF Contrastive Grasp Proposal Network

03/29/2021
by   Xinghao Zhu, et al.
0

Proposing grasp poses for novel objects is an essential component for any robot manipulation task. Planning six degrees of freedom (DoF) grasps with a single camera, however, is challenging due to the complex object shape, incomplete object information, and sensor noise. In this paper, we present a 6-DoF contrastive grasp proposal network (CGPN) to infer 6-DoF grasps from a single-view depth image. First, an image encoder is used to extract the feature map from the input depth image, after which 3-DoF grasp regions are proposed from the feature map with a rotated region proposal network. Feature vectors that within the proposed grasp regions are then extracted and refined to 6-DoF grasps. The proposed model is trained offline with synthetic grasp data. To improve the robustness in reality and bridge the simulation-to-real gap, we further introduce a contrastive learning module and variant image processing techniques during the training. CGPN can locate collision-free grasps of an object using a single-view depth image within 0.5 seconds. Experiments on a physical robot further demonstrate the effectiveness of the algorithm.

READ FULL TEXT

page 1

page 5

page 6

research
05/25/2019

6-DOF GraspNet: Variational Grasp Generation for Object Manipulation

Generating grasp poses is a crucial component for any robot object manip...
research
03/03/2021

RGB Matters: Learning 7-DoF Grasp Poses on Monocular RGBD Images

General object grasping is an important yet unsolved problem in the fiel...
research
09/18/2023

Affordance-Driven Next-Best-View Planning for Robotic Grasping

Grasping occluded objects in cluttered environments is an essential comp...
research
09/18/2020

6-DoF Grasp Planning using Fast 3D Reconstruction and Grasp Quality CNN

Recent consumer demand for home robots has accelerated performance of ro...
research
05/13/2020

Action Image Representation: Learning Scalable Deep Grasping Policies with Zero Real World Data

This paper introduces Action Image, a new grasp proposal representation ...
research
09/26/2020

Grasp Proposal Networks: An End-to-End Solution for Visual Learning of Robotic Grasps

Learning robotic grasps from visual observations is a promising yet chal...
research
08/07/2019

Grasp Type Estimation for Myoelectric Prostheses using Point Cloud Feature Learning

Prosthetic hands can help people with limb difference to return to their...

Please sign up or login with your details

Forgot password? Click here to reset