Exploiting Multiple Priors for Neural 3D Indoor Reconstruction

09/13/2023
by   Federico Lincetto, et al.
0

Neural implicit modeling permits to achieve impressive 3D reconstruction results on small objects, while it exhibits significant limitations in large indoor scenes. In this work, we propose a novel neural implicit modeling method that leverages multiple regularization strategies to achieve better reconstructions of large indoor environments, while relying only on images. A sparse but accurate depth prior is used to anchor the scene to the initial model. A dense but less accurate depth prior is also introduced, flexible enough to still let the model diverge from it to improve the estimated geometry. Then, a novel self-supervised strategy to regularize the estimated surface normals is presented. Finally, a learnable exposure compensation scheme permits to cope with challenging lighting conditions. Experimental results show that our approach produces state-of-the-art 3D reconstructions in challenging indoor scenarios.

READ FULL TEXT

page 2

page 6

page 8

page 9

page 18

page 19

page 20

page 21

research
11/10/2020

SelfDeco: Self-Supervised Monocular Depth Completion in Challenging Indoor Environments

We present a novel algorithm for self-supervised monocular depth complet...
research
06/30/2023

Neural 3D Scene Reconstruction from Multiple 2D Images without 3D Supervision

Neural 3D scene reconstruction methods have achieved impressive performa...
research
09/02/2021

NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereo

In this work, we present a new multi-view depth estimation method that u...
research
08/29/2023

DebSDF: Delving into the Details and Bias of Neural Indoor Scene Reconstruction

In recent years, the neural implicit surface has emerged as a powerful r...
research
04/05/2022

iSDF: Real-Time Neural Signed Distance Fields for Robot Perception

We present iSDF, a continual learning system for real-time signed distan...
research
03/01/2023

P^2SDF for Neural Indoor Scene Reconstruction

Given only a set of images, neural implicit surface representation has s...
research
09/18/2023

Improving Neural Indoor Surface Reconstruction with Mask-Guided Adaptive Consistency Constraints

3D scene reconstruction from 2D images has been a long-standing task. In...

Please sign up or login with your details

Forgot password? Click here to reset