Active Visuo-Haptic Object Shape Completion

03/17/2022
by   Lukas Rustler, et al.
0

Recent advancements in object shape completion have enabled impressive object reconstructions using only visual input. However, due to self-occlusion, the reconstructions have high uncertainty in the occluded object parts, which negatively impacts the performance of downstream robotic tasks such as grasping. In this work, we propose an active visuo-haptic shape completion method called Act-VH that actively computes where to touch the objects based on the reconstruction uncertainty. Act-VH reconstructs objects from point clouds and calculates the reconstruction uncertainty using IGR, a recent state-of-the-art implicit surface deep neural network. We experimentally evaluate the reconstruction accuracy of Act-VH against five baselines in simulation and in the real world. We also propose a new simulation environment for this purpose. The results show that Act-VH outperforms all baselines and that an uncertainty-driven haptic exploration policy leads to higher reconstruction accuracy than a random policy and a policy driven by Gaussian Process Implicit Surfaces. As a final experiment, we evaluate Act-VH and the best reconstruction baseline on grasping 10 novel objects. The results show that Act-VH reaches a significantly higher grasp success rate than the baseline on all objects. Together, this work opens up the door for using active visuo-haptic shape completion in more complex cluttered scenes.

READ FULL TEXT

page 1

page 5

page 7

research
07/01/2021

TransSC: Transformer-based Shape Completion for Grasp Evaluation

Currently, robotic grasping methods based on sparse partial point clouds...
research
09/09/2022

Towards Confidence-guided Shape Completion for Robotic Applications

Many robotic tasks involving some form of 3D visual perception greatly b...
research
09/14/2021

Object Shell Reconstruction: Camera-centric Object Representation for Robotic Grasping

Robots can effectively grasp and manipulate objects using their 3D model...
research
03/08/2023

Efficient Visuo-Haptic Object Shape Completion for Robot Manipulation

For robot manipulation, a complete and accurate object shape is desirabl...
research
09/17/2022

Uncertainty Guided Policy for Active Robotic 3D Reconstruction using Neural Radiance Fields

In this paper, we tackle the problem of active robotic 3D reconstruction...
research
08/01/2023

Shape Completion with Prediction of Uncertain Regions

Shape completion, i.e., predicting the complete geometry of an object fr...
research
03/03/2020

Implicit Functions in Feature Space for 3D Shape Reconstruction and Completion

While many works focus on 3D reconstruction from images, in this paper, ...

Please sign up or login with your details

Forgot password? Click here to reset