A Robotic Visual Grasping Design: Rethinking Convolution Neural Network with High-Resolutions

09/15/2022
by   Zhangli Zhou, et al.
0

High-resolution representations are important for vision-based robotic grasping problems. Existing works generally encode the input images into low-resolution representations via sub-networks and then recover high-resolution representations. This will lose spatial information, and errors introduced by the decoder will be more serious when multiple types of objects are considered or objects are far away from the camera. To address these issues, we revisit the design paradigm of CNN for robotic perception tasks. We demonstrate that using parallel branches as opposed to serial stacked convolutional layers will be a more powerful design for robotic visual grasping tasks. In particular, guidelines of neural network design are provided for robotic perception tasks, e.g., high-resolution representation and lightweight design, which respond to the challenges in different manipulation scenarios. We then develop a novel grasping visual architecture referred to as HRG-Net, a parallel-branch structure that always maintains a high-resolution representation and repeatedly exchanges information across resolutions. Extensive experiments validate that these two designs can effectively enhance the accuracy of visual-based grasping and accelerate network training. We show a series of comparative experiments in real physical environments at Youtube: https://youtu.be/Jhlsp-xzHFY.

READ FULL TEXT

page 1

page 4

page 5

page 6

research
08/20/2019

Deep High-Resolution Representation Learning for Visual Recognition

High-resolution representations are essential for position-sensitive vis...
research
07/02/2020

Towards Generalization and Data Efficient Learning of Deep Robotic Grasping

Deep reinforcement learning (DRL) has been proven to be a powerful parad...
research
11/23/2022

Autonomous Vision-based Rapid Aerial Grasping

In a future with autonomous robots, visual and spatial perception is of ...
research
03/16/2020

Resolution Adaptive Networks for Efficient Inference

Recently, adaptive inference is gaining increasing attention due to its ...
research
09/09/2022

Towards Confidence-guided Shape Completion for Robotic Applications

Many robotic tasks involving some form of 3D visual perception greatly b...
research
01/25/2021

Lightweight Convolutional Neural Network with Gaussian-based Grasping Representation for Robotic Grasping Detection

The method of deep learning has achieved excellent results in improving ...
research
11/17/2022

AligNeRF: High-Fidelity Neural Radiance Fields via Alignment-Aware Training

Neural Radiance Fields (NeRFs) are a powerful representation for modelin...

Please sign up or login with your details

Forgot password? Click here to reset