Active Implicit Object Reconstruction using Uncertainty-guided Next-Best-View Optimziation

03/29/2023
by   Dongyu Yan, et al.
0

Actively planning sensor views during object reconstruction is essential to autonomous mobile robots. This task is usually performed by evaluating information gain from an explicit uncertainty map. Existing algorithms compare options among a set of preset candidate views and select the next-best-view from them. In contrast to these, we take the emerging implicit representation as the object model and seamlessly combine it with the active reconstruction task. To fully integrate observation information into the model, we propose a supervision method specifically for object-level reconstruction that considers both valid and free space. Additionally, to directly evaluate view information from the implicit object model, we introduce a sample-based uncertainty evaluation method. It samples points on rays directly from the object model and uses variations of implicit function inferences as the uncertainty metrics, with no need for voxel traversal or an additional information map. Leveraging the differentiability of our metrics, it is possible to optimize the next-best-view by maximizing the uncertainty continuously. This does away with the traditionally-used candidate views setting, which may provide sub-optimal results. Experiments in simulations and real-world scenes show that our method effectively improves the reconstruction accuracy and the view-planning efficiency of active reconstruction tasks. The proposed system is going to open source at https://github.com/HITSZ-NRSL/ActiveImplicitRecon.git.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

page 7

page 8

research
09/17/2022

Uncertainty Guided Policy for Active Robotic 3D Reconstruction using Neural Radiance Fields

In this paper, we tackle the problem of active robotic 3D reconstruction...
research
05/08/2018

Active Object Reconstruction Using a Guided View Planner

Inspired by the recent advance of image-based object reconstruction usin...
research
02/22/2020

Actively Mapping Industrial Structures with Information Gain-Based Planning on a Quadruped Robot

In this paper, we develop an online active mapping system to enable a qu...
research
04/22/2023

Pred-NBV: Prediction-guided Next-Best-View for 3D Object Reconstruction

Prediction-based active perception has shown the potential to improve th...
research
07/22/2022

NeurAR: Neural Uncertainty for Autonomous 3D Reconstruction

Implicit neural representations have shown compelling results in offline...
research
08/30/2023

Active Neural Mapping

We address the problem of active mapping with a continually-learned neur...
research
05/14/2019

Supervised Learning of the Next-Best-View for 3D Object Reconstruction

Motivated by the advances in 3D sensing technology and the spreading of ...

Please sign up or login with your details

Forgot password? Click here to reset