Multi-Fingered Grasp Planning via Inference in Deep Neural Networks

01/25/2020
by   Qingkai Lu, et al.
0

We propose a novel approach to multi-fingered grasp planning leveraging learned deep neural network models. We train a voxel-based 3D convolutional neural network to predict grasp success probability as a function of both visual information of an object and grasp configuration. We can then formulate grasp planning as inferring the grasp configuration which maximizes the probability of grasp success. In addition, we learn a prior over grasp configurations as a mixture density network conditioned on our voxel-based object representation. We show that this object conditional prior improves grasp inference when used with the learned grasp success prediction network when compared to a learned, object-agnostic prior, or an uninformed uniform prior. Our work is the first to directly plan high quality multi-fingered grasps in configuration space using a deep neural network without the need of an external planner. We validate our inference method performing multi-finger grasping on a physical robot. Our experimental results show that our planning method outperforms existing grasp planning methods for neural networks.

READ FULL TEXT

page 5

page 6

page 8

research
04/10/2018

Planning Multi-Fingered Grasps as Probabilistic Inference in a Learned Deep Network

We propose a novel approach to multi-fingered grasp planning leveraging ...
research
01/10/2019

Modeling Grasp Type Improves Learning-Based Grasp Planning

Different manipulation tasks require different types of grasps. For exam...
research
06/06/2020

Multi-Fingered Active Grasp Learning

Learning-based approaches to grasp planning are preferred over analytica...
research
06/19/2022

Learning Grasp Ability Enhancement through Deep Shape Generation

Data-driven especially deep learning-based approaches have become a domi...
research
10/13/2022

Learning to Efficiently Plan Robust Frictional Multi-Object Grasps

We consider a decluttering problem where multiple rigid convex polygonal...
research
03/02/2019

Robust Grasp Planning Over Uncertain Shape Completions

We present a method for planning robust grasps over uncertain shape comp...
research
10/17/2017

Domain Randomization and Generative Models for Robotic Grasping

Deep learning-based robotic grasping has made significant progress the p...

Please sign up or login with your details

Forgot password? Click here to reset