Deep Learning a Grasp Function for Grasping under Gripper Pose Uncertainty

08/07/2016
by   Edward Johns, et al.
0

This paper presents a new method for parallel-jaw grasping of isolated objects from depth images, under large gripper pose uncertainty. Whilst most approaches aim to predict the single best grasp pose from an image, our method first predicts a score for every possible grasp pose, which we denote the grasp function. With this, it is possible to achieve grasping robust to the gripper's pose uncertainty, by smoothing the grasp function with the pose uncertainty function. Therefore, if the single best pose is adjacent to a region of poor grasp quality, that pose will no longer be chosen, and instead a pose will be chosen which is surrounded by a region of high grasp quality. To learn this function, we train a Convolutional Neural Network which takes as input a single depth image of an object, and outputs a score for each grasp pose across the image. Training data for this is generated by use of physics simulation and depth image simulation with 3D object meshes, to enable acquisition of sufficient data without requiring exhaustive real-world experiments. We evaluate with both synthetic and real experiments, and show that the learned grasp score is more robust to gripper pose uncertainty than when this uncertainty is not accounted for.

READ FULL TEXT

page 4

page 7

page 8

research
04/23/2021

Automatic Grasp Pose Generation for Parallel Jaw Grippers

This paper presents a novel approach for the automatic offline grasp pos...
research
10/06/2022

A Real2Sim2Real Method for Robust Object Grasping with Neural Surface Reconstruction

Recent 3D-based manipulation methods either directly predict the grasp p...
research
01/09/2020

Domain Independent Unsupervised Learning to grasp the Novel Objects

One of the main challenges in the vision-based grasping is the selection...
research
12/11/2019

A Billion Ways to Grasp: An Evaluation of Grasp Sampling Schemes on a Dense, Physics-based Grasp Data Set

Robot grasping is often formulated as a learning problem. With the incre...
research
01/12/2021

Transferring Experience from Simulation to the Real World for Precise Pick-And-Place Tasks in Highly Cluttered Scenes

In this paper, we introduce a novel learning-based approach for grasping...
research
10/14/2019

Learning to Generate 6-DoF Grasp Poses with Reachability Awareness

Motivated by the stringent requirements of unstructured real-world where...

Please sign up or login with your details

Forgot password? Click here to reset