6-DoF Contrastive Grasp Proposal Network

by   Xinghao Zhu, et al.

Proposing grasp poses for novel objects is an essential component for any robot manipulation task. Planning six degrees of freedom (DoF) grasps with a single camera, however, is challenging due to the complex object shape, incomplete object information, and sensor noise. In this paper, we present a 6-DoF contrastive grasp proposal network (CGPN) to infer 6-DoF grasps from a single-view depth image. First, an image encoder is used to extract the feature map from the input depth image, after which 3-DoF grasp regions are proposed from the feature map with a rotated region proposal network. Feature vectors that within the proposed grasp regions are then extracted and refined to 6-DoF grasps. The proposed model is trained offline with synthetic grasp data. To improve the robustness in reality and bridge the simulation-to-real gap, we further introduce a contrastive learning module and variant image processing techniques during the training. CGPN can locate collision-free grasps of an object using a single-view depth image within 0.5 seconds. Experiments on a physical robot further demonstrate the effectiveness of the algorithm.



There are no comments yet.


page 1

page 5

page 6


6-DOF GraspNet: Variational Grasp Generation for Object Manipulation

Generating grasp poses is a crucial component for any robot object manip...

RGB Matters: Learning 7-DoF Grasp Poses on Monocular RGBD Images

General object grasping is an important yet unsolved problem in the fiel...

Beyond Top-Grasps Through Scene Completion

Current end-to-end grasp planning methods propose grasps in the order of...

6-DoF Grasp Planning using Fast 3D Reconstruction and Grasp Quality CNN

Recent consumer demand for home robots has accelerated performance of ro...

S4G: Amodal Single-view Single-Shot SE(3) Grasp Detection in Cluttered Scenes

Grasping is among the most fundamental and long-lasting problems in robo...

Grasp Proposal Networks: An End-to-End Solution for Visual Learning of Robotic Grasps

Learning robotic grasps from visual observations is a promising yet chal...

Generating Grasp Poses for a High-DOF Gripper Using Neural Networks

We present a learning-based method to represent grasp poses of a high-DO...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.