Multi-Fingered Grasp Planning via Inference in Deep Neural Networks

by   Qingkai Lu, et al.

We propose a novel approach to multi-fingered grasp planning leveraging learned deep neural network models. We train a voxel-based 3D convolutional neural network to predict grasp success probability as a function of both visual information of an object and grasp configuration. We can then formulate grasp planning as inferring the grasp configuration which maximizes the probability of grasp success. In addition, we learn a prior over grasp configurations as a mixture density network conditioned on our voxel-based object representation. We show that this object conditional prior improves grasp inference when used with the learned grasp success prediction network when compared to a learned, object-agnostic prior, or an uninformed uniform prior. Our work is the first to directly plan high quality multi-fingered grasps in configuration space using a deep neural network without the need of an external planner. We validate our inference method performing multi-finger grasping on a physical robot. Our experimental results show that our planning method outperforms existing grasp planning methods for neural networks.



There are no comments yet.


page 5

page 6

page 8


Planning Multi-Fingered Grasps as Probabilistic Inference in a Learned Deep Network

We propose a novel approach to multi-fingered grasp planning leveraging ...

Modeling Grasp Type Improves Learning-Based Grasp Planning

Different manipulation tasks require different types of grasps. For exam...

Multi-Fingered Active Grasp Learning

Learning-based approaches to grasp planning are preferred over analytica...

Domain Randomization and Generative Models for Robotic Grasping

Deep learning-based robotic grasping has made significant progress the p...

Excavation Learning for Rigid Objects in Clutter

Autonomous excavation for hard or compact materials, especially irregula...

Robust Grasp Planning Over Uncertain Shape Completions

We present a method for planning robust grasps over uncertain shape comp...

Simulation-based Bayesian inference for multi-fingered robotic grasping

Multi-fingered robotic grasping is an undeniable stepping stone to unive...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.