Intent-based Object Grasping by a Robot using Deep Learning

by   Faheem Zunjani, et al.

A robot needs to predict an ideal rectangle for optimal object grasping based on the intent for that grasp. Mask Regional - Convolutional Neural Network (Detectron) can be used to generate the object mask and for object detection and a Convolutional Neural Network (CNN) can be used for ideal grasp rectangle prediction according to the supplied intent, as described in this paper. The masked image obtained from Detectron along with the metadata of the intent type has been fed to the Fully-Connected layers of the CNN which would generate the desired optimal rectangle for the specific intent and object. Before settling for a CNN for optimal rectangle prediction, conventional Neural Networks with different hidden layers have been tried and the accuracy achieved was low. A CNN has then been developed and tested with different layers and sizes of pool and strides to settle on the final CNN model that has been discussed here. The optimal predicted rectangle is then fed to a robot, ROS simulation of Baxter robot in this case, to perform the actual grasping of the object at the predicted location.



There are no comments yet.


page 1

page 2

page 3

page 4

page 5


Object affordance as a guide for grasp-type recognition

Recognizing human grasping strategies is an important factor in robot te...

Improved GQ-CNN: Deep Learning Model for Planning Robust Grasps

Recent developments in the field of robot grasping have shown great impr...

Associating Grasp Configurations with Hierarchical Features in Convolutional Neural Networks

In this work, we provide a solution for posturing the anthropomorphic Ro...

Including Image-based Perception in Disturbance Observer for Warehouse Drones

Grasping and releasing objects would cause oscillations to delivery dron...

Optimising the Input Image to Improve Visual Relationship Detection

Visual Relationship Detection is defined as, given an image composed of ...

Domestic waste detection and grasping points for robotic picking up

This paper presents an AI system applied to location and robotic graspin...

Grasp-type Recognition Leveraging Object Affordance

A key challenge in robot teaching is grasp-type recognition with a singl...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.