Log In Sign Up

AdaGrasp: Learning an Adaptive Gripper-Aware Grasping Policy

by   Zhenjia Xu, et al.

This paper aims to improve robots' versatility and adaptability by allowing them to use a large variety of end-effector tools and quickly adapt to new tools. We propose AdaGrasp, a method to learn a single grasping policy that generalizes to novel grippers. By training on a large collection of grippers, our algorithm is able to acquire generalizable knowledge of how different grippers should be used in various tasks. Given a visual observation of the scene and the gripper, AdaGrasp infers the possible grasping poses and their grasp scores by computing the cross convolution between the shape encodings of the input gripper and scene. Intuitively, this cross convolution operation can be considered as an efficient way of exhaustively matching the scene geometry with gripper geometry under different grasp poses (i.e., translations and orientations), where a good "match" of 3D geometry will lead to a successful grasp. We validate our methods in both simulation and real-world environment. Our experiment shows that AdaGrasp significantly outperforms the existing multi-gripper grasping policy method, especially when handling cluttered environments and partial observations. Video is available at


page 1

page 2

page 5

page 6


DexTransfer: Real World Multi-fingered Dexterous Grasping with Minimal Human Demonstrations

Teaching a multi-fingered dexterous robot to grasp objects in the real w...

Efficient learning of goal-oriented push-grasping synergy in clutter

We focus on the task of goal-oriented grasping, in which a robot is supp...

Learning Object Relations with Graph Neural Networks for Target-Driven Grasping in Dense Clutter

Robots in the real world frequently come across identical objects in den...

Learning 6-DOF Grasping Interaction with Deep Geometry-aware 3D Representations

This paper focuses on the problem of learning 6-DOF grasping with a para...

GraspNet: A Large-Scale Clustered and Densely Annotated Datase for Object Grasping

Object grasping is critical for many applications, which is also a chall...

SuctionNet-1Billion: A Large-Scale Benchmark for Suction Grasping

Suction is an important solution for the longstanding robotic grasping p...

Target-mass Grasping of Entangled Food using Pre-grasping Post-grasping

Food packing industries typically use seasonal ingredients with immense ...