A Real-time Robotic Grasp Approach with Oriented Anchor Box

09/08/2018
by   Hanbo Zhang, et al.
0

Grasp is an essential skill for robots to interact with humans and the environment. In this paper, we build a vision-based, robust and real-time robotic grasp approach with fully convolutional neural network. The main component of our approach is a grasp detection network with oriented anchor boxes as detection priors. Because the orientation of detected grasps is significant, which determines the rotation angle configuration of the gripper, we propose the Orientation Anchor Box Mechanism to regress grasp angle based on predefined assumption instead of classification or regression without any priors. With oriented anchor boxes, the grasps can be predicted more accurately and efficiently. Besides, to accelerate the network training and further improve the performance of angle regression, Angle Matching is proposed during training instead of Jaccard Index Matching. Five-fold cross validation results demonstrate that our proposed algorithm achieves an accuracy of 98.8 in image-wise split and object-wise split respectively, and the speed of our detection algorithm is 67 FPS with GTX 1080Ti, outperforming all the current state-of-the-art grasp detection algorithms on Cornell Dataset both in speed and accuracy. Robotic experiments demonstrate the robustness and generalization ability in unseen objects and real-world environment, with the average success rate of 90.0 Baxter robot platform.

READ FULL TEXT

page 3

page 7

page 9

page 10

page 11

research
03/06/2018

Fully Convolutional Grasp Detection Network with Oriented Anchor Box

In this paper, we present a real-time approach to predict multiple grasp...
research
08/30/2018

RoI-based Robotic Grasp Detection in Object Overlapping Scenes Using Convolutional Neural Network

Grasp detection is an essential skill for widespread use of robots. Rece...
research
06/17/2023

NBMOD: Find It and Grasp It in Noisy Background

Grasping objects is a fundamental yet important capability of robots, an...
research
02/01/2018

Deep Grasp: Detection and Localization of Grasps with Deep Neural Networks

A deep learning architecture is proposed to predict graspable locations ...
research
08/03/2021

Double-Dot Network for Antipodal Grasp Detection

This paper proposes a new deep learning approach to antipodal grasp dete...
research
05/30/2022

Robotic grasp detection based on Transformer

Grasp detection in a cluttered environment is still a great challenge fo...
research
11/22/2021

MidNet: An Anchor-and-Angle-Free Detector for Oriented Ship Detection in Aerial Images

Ship detection in aerial images remains an active yet challenging task d...

Please sign up or login with your details

Forgot password? Click here to reset