Towards Confidence-guided Shape Completion for Robotic Applications

09/09/2022
by   Andrea Rosasco, et al.
0

Many robotic tasks involving some form of 3D visual perception greatly benefit from a complete knowledge of the working environment. However, robots often have to tackle unstructured environments and their onboard visual sensors can only provide incomplete information due to limited workspaces, clutter or object self-occlusion. In recent years, deep learning architectures for shape completion have begun taking traction as effective means of inferring a complete 3D object representation from partial visual data. Nevertheless, most of the existing state-of-the-art approaches provide a fixed output resolution in the form of voxel grids, strictly related to the size of the neural network output stage. While this is enough for some tasks, e.g. obstacle avoidance in navigation, grasping and manipulation require finer resolutions and simply scaling up the neural network outputs is computationally expensive. In this paper, we address this limitation by proposing an object shape completion method based on an implicit 3D representation providing a confidence value for each reconstructed point. As a second contribution, we propose a gradient-based method for efficiently sampling such implicit function at an arbitrary resolution, tunable at inference time. We experimentally validate our approach by comparing reconstructed shapes with ground truths, and by deploying our shape completion algorithm in a robotic grasping pipeline. In both cases, we compare results with a state-of-the-art shape completion approach.

READ FULL TEXT

page 1

page 5

page 6

research
03/17/2022

Active Visuo-Haptic Object Shape Completion

Recent advancements in object shape completion have enabled impressive o...
research
07/01/2021

TransSC: Transformer-based Shape Completion for Grasp Evaluation

Currently, robotic grasping methods based on sparse partial point clouds...
research
09/15/2022

A Robotic Visual Grasping Design: Rethinking Convolution Neural Network with High-Resolutions

High-resolution representations are important for vision-based robotic g...
research
03/15/2023

Panoptic Mapping with Fruit Completion and Pose Estimation for Horticultural Robots

Monitoring plants and fruits at high resolution play a key role in the f...
research
12/01/2016

Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis

We introduce a data-driven approach to complete partial 3D shapes throug...
research
04/13/2016

VConv-DAE: Deep Volumetric Shape Learning Without Object Labels

With the advent of affordable depth sensors, 3D capture becomes more and...
research
09/12/2021

Multiresolution Deep Implicit Functions for 3D Shape Representation

We introduce Multiresolution Deep Implicit Functions (MDIF), a hierarchi...

Please sign up or login with your details

Forgot password? Click here to reset