Multi-FinGAN: Generative Coarse-To-Fine Sampling of Multi-Finger Grasps

by   Jens Lundell, et al.

While there exists a large number of methods for manipulating rigid objects with parallel-jaw grippers, grasping with multi-finger robotic hands remains a quite unexplored research topic. Reasoning and planning collision-free trajectories on the additional degrees of freedom of several fingers represents an important challenge that, so far, involves computationally costly and slow processes. In this work, we present Multi-FinGAN, a fast generative multi-finger grasp sampling method that synthesizes high quality grasps directly from RGB-D images in about a second. We achieve this by training in an end-to-end fashion a coarse-to-fine model composed of a classification network that distinguishes grasp types according to a specific taxonomy and a refinement network that produces refined grasp poses and joint angles. We experimentally validate and benchmark our method against standard grasp-sampling methods on 790 grasps in simulation and 20 grasps on a real Franka Emika Panda. All experimental results using our method show consistent improvements both in terms of grasp quality metrics and grasp success rate. Remarkably, our approach is up to 20-30 times faster than the baseline, a significant improvement that opens the door to feedback-based grasp re-planning and task informative grasping.



There are no comments yet.


page 1

page 3

page 5

page 6


DDGC: Generative Deep Dexterous Grasping in Clutter

Recent advances in multi-fingered robotic grasping have enabled fast 6-D...

Beyond Top-Grasps Through Scene Completion

Current end-to-end grasp planning methods propose grasps in the order of...

A Coarse-To-Fine (C2F) Representation for End-To-End 6-DoF Grasp Detection

We proposed an end-to-end grasp detection network, Grasp Detection Netwo...

Deformation-Aware Data-Driven Grasp Synthesis

Grasp synthesis for 3D deformable objects remains a little-explored topi...

Planning Multi-Fingered Grasps as Probabilistic Inference in a Learned Deep Network

We propose a novel approach to multi-fingered grasp planning leveraging ...

Generating Grasp Poses for a High-DOF Gripper Using Neural Networks

We present a learning-based method to represent grasp poses of a high-DO...

Fit2Form: 3D Generative Model for Robot Gripper Form Design

The 3D shape of a robot's end-effector plays a critical role in determin...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.