PointNet++ Grasping: Learning An End-to-end Spatial Grasp Generation Algorithm from Sparse Point Clouds

by   Peiyuan Ni, et al.

Grasping for novel objects is important for robot manipulation in unstructured environments. Most of current works require a grasp sampling process to obtain grasp candidates, combined with local feature extractor using deep learning. This pipeline is time-costly, expecially when grasp points are sparse such as at the edge of a bowl. In this paper, we propose an end-to-end approach to directly predict the poses, categories and scores (qualities) of all the grasps. It takes the whole sparse point clouds as the input and requires no sampling or search process. Moreover, to generate training data of multi-object scene, we propose a fast multi-object grasp detection algorithm based on Ferrari Canny metrics. A single-object dataset (79 objects from YCB object set, 23.7k grasps) and a multi-object dataset (20k point clouds with annotations and masks) are generated. A PointNet++ based network combined with multi-mask loss is introduced to deal with different training points. The whole weight size of our network is only about 11.6M, which takes about 102ms for a whole prediction process using a GeForce 840M GPU. Our experiment shows our work get 71.43 than current state-of-art works.



There are no comments yet.


page 1

page 4

page 6


GPR: Grasp Pose Refinement Network for Cluttered Scenes

Object grasping in cluttered scenes is a widely investigated field of ro...

REGRAD: A Large-Scale Relational Grasp Dataset for Safe and Object-Specific Robotic Grasping in Clutter

Despite the impressive progress achieved in robust grasp detection, robo...

TransSC: Transformer-based Shape Completion for Grasp Evaluation

Currently, robotic grasping methods based on sparse partial point clouds...

A Coarse-To-Fine (C2F) Representation for End-To-End 6-DoF Grasp Detection

We proposed an end-to-end grasp detection network, Grasp Detection Netwo...

NimbRo Logistics – Project KittingBot

Recovering the pose of an object from mere point clouds is often hindere...

Learning to Regrasp by Learning to Place

In this paper, we explore whether a robot can learn to regrasp a diverse...

Grasp Type Estimation for Myoelectric Prostheses using Point Cloud Feature Learning

Prosthetic hands can help people with limb difference to return to their...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.