DebSDF: Delving into the Details and Bias of Neural Indoor Scene Reconstruction

08/29/2023
by   Yuting Xiao, et al.
0

In recent years, the neural implicit surface has emerged as a powerful representation for multi-view surface reconstruction due to its simplicity and state-of-the-art performance. However, reconstructing smooth and detailed surfaces in indoor scenes from multi-view images presents unique challenges. Indoor scenes typically contain large texture-less regions, making the photometric loss unreliable for optimizing the implicit surface. Previous work utilizes monocular geometry priors to improve the reconstruction in indoor scenes. However, monocular priors often contain substantial errors in thin structure regions due to domain gaps and the inherent inconsistencies when derived independently from different views. This paper presents DebSDF to address these challenges, focusing on the utilization of uncertainty in monocular priors and the bias in SDF-based volume rendering. We propose an uncertainty modeling technique that associates larger uncertainties with larger errors in the monocular priors. High-uncertainty priors are then excluded from optimization to prevent bias. This uncertainty measure also informs an importance-guided ray sampling and adaptive smoothness regularization, enhancing the learning of fine structures. We further introduce a bias-aware signed distance function to density transformation that takes into account the curvature and the angle between the view direction and the SDF normals to reconstruct fine details better. Our approach has been validated through extensive experiments on several challenging datasets, demonstrating improved qualitative and quantitative results in reconstructing thin structures in indoor scenes, thereby outperforming previous work.

READ FULL TEXT

page 2

page 4

page 9

page 10

page 11

page 12

page 13

page 17

research
06/27/2022

NeuRIS: Neural Reconstruction of Indoor Scenes Using Normal Priors

Reconstructing 3D indoor scenes from 2D images is an important task in m...
research
06/01/2022

MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstruction

In recent years, neural implicit surface reconstruction methods have bec...
research
09/14/2023

Indoor Scene Reconstruction with Fine-Grained Details Using Hybrid Representation and Normal Prior Enhancement

The reconstruction of indoor scenes from multi-view RGB images is challe...
research
10/13/2022

NeuralRoom: Geometry-Constrained Neural Implicit Surfaces for Indoor Scene Reconstruction

We present a novel neural surface reconstruction method called NeuralRoo...
research
05/22/2023

Fast Monocular Scene Reconstruction with Global-Sparse Local-Dense Grids

Indoor scene reconstruction from monocular images has long been sought a...
research
09/13/2023

Exploiting Multiple Priors for Neural 3D Indoor Reconstruction

Neural implicit modeling permits to achieve impressive 3D reconstruction...
research
03/10/2020

Convolutional Occupancy Networks

Recently, implicit neural representations have gained popularity for lea...

Please sign up or login with your details

Forgot password? Click here to reset