Deep Learning for Detecting Robotic Grasps

01/16/2013
by   Ian Lenz, et al.
0

We consider the problem of detecting robotic grasps in an RGB-D view of a scene containing objects. In this work, we apply a deep learning approach to solve this problem, which avoids time-consuming hand-design of features. This presents two main challenges. First, we need to evaluate a huge number of candidate grasps. In order to make detection fast, as well as robust, we present a two-step cascaded structure with two deep networks, where the top detections from the first are re-evaluated by the second. The first network has fewer features, is faster to run, and can effectively prune out unlikely candidate grasps. The second, with more features, is slower but has to run only on the top few detections. Second, we need to handle multimodal inputs well, for which we present a method to apply structured regularization on the weights based on multimodal group regularization. We demonstrate that our method outperforms the previous state-of-the-art methods in robotic grasp detection, and can be used to successfully execute grasps on two different robotic platforms.

READ FULL TEXT

page 1

page 3

page 5

page 6

page 7

page 8

research
03/04/2018

Classification based Grasp Detection using Spatial Transformer Network

Robotic grasp detection task is still challenging, particularly for nove...
research
12/19/2018

Rotation Ensemble Module for Detecting Rotation-Invariant Features

Deep learning has improved many computer vision tasks by utilizing data-...
research
03/01/2022

Robots Autonomously Detecting People: A Multimodal Deep Contrastive Learning Method Robust to Intraclass Variations

Robotic detection of people in crowded and/or cluttered human-centered e...
research
09/14/2019

Deep Robotic Prediction with hierarchical RGB-D Fusion

Robotic is a fundamental operation in robotic control task goals. We con...
research
09/10/2019

Learning Actions from Human Demonstration Video for Robotic Manipulation

Learning actions from human demonstration is an emerging trend for desig...
research
08/19/2021

Progressive and Selective Fusion Network for High Dynamic Range Imaging

This paper considers the problem of generating an HDR image of a scene f...
research
03/08/2021

HANDS: A Multimodal Dataset for Modeling Towards Human Grasp Intent Inference in Prosthetic Hands

Upper limb and hand functionality is critical to many activities of dail...

Please sign up or login with your details

Forgot password? Click here to reset