Attention based visual analysis for fast grasp planning with multi-fingered robotic hand

09/12/2018
by   Zhen Deng, et al.
1

We present an attention based visual analysis framework to compute grasp-relevant information in order to guide grasp planning using a multi-fingered robotic hand. Our approach uses a computational visual attention model to locate regions of interest in a scene, and uses a deep convolutional neural network to detect grasp type and point for a sub-region of the object presented in a region of interest. We demonstrate the proposed framework in object grasping tasks, in which the information generated from the proposed framework is used as prior information to guide the grasp planning. Results show that the proposed framework can not only speed up grasp planning with more stable configurations, but also is able to handle unknown objects. Furthermore, our framework can handle cluttered scenarios. A new Grasp Type Dataset (GTD) that considers 6 commonly used grasp types and covers 12 household objects is also presented.

READ FULL TEXT

page 7

page 8

research
03/30/2020

Real-time Fruit Recognition and Grasp Estimation for Autonomous Apple harvesting

In this research, a fully neural network based visual perception framewo...
research
08/30/2018

RoI-based Robotic Grasp Detection in Object Overlapping Scenes Using Convolutional Neural Network

Grasp detection is an essential skill for widespread use of robots. Rece...
research
06/29/2018

Workspace Aware Online Grasp Planning

This work provides a framework for a workspace aware online grasp planne...
research
02/27/2021

Object affordance as a guide for grasp-type recognition

Recognizing human grasping strategies is an important factor in robot te...
research
04/10/2018

Planning Multi-Fingered Grasps as Probabilistic Inference in a Learned Deep Network

We propose a novel approach to multi-fingered grasp planning leveraging ...
research
06/27/2021

Improving Grasp Planning Efficiency with Human Grasp Tendencies*

After a grasp has been planned, if the object orientation changes, the i...
research
09/17/2021

Learning to Model the Grasp Space of an Underactuated Robot Gripper Using Variational Autoencoder

Grasp planning and most specifically the grasp space exploration is stil...

Please sign up or login with your details

Forgot password? Click here to reset