Improving Neural Indoor Surface Reconstruction with Mask-Guided Adaptive Consistency Constraints

09/18/2023
by   Xinyi Yu, et al.
0

3D scene reconstruction from 2D images has been a long-standing task. Instead of estimating per-frame depth maps and fusing them in 3D, recent research leverages the neural implicit surface as a unified representation for 3D reconstruction. Equipped with data-driven pre-trained geometric cues, these methods have demonstrated promising performance. However, inaccurate prior estimation, which is usually inevitable, can lead to suboptimal reconstruction quality, particularly in some geometrically complex regions. In this paper, we propose a two-stage training process, decouple view-dependent and view-independent colors, and leverage two novel consistency constraints to enhance detail reconstruction performance without requiring extra priors. Additionally, we introduce an essential mask scheme to adaptively influence the selection of supervision constraints, thereby improving performance in a self-supervised paradigm. Experiments on synthetic and real-world datasets show the capability of reducing the interference from prior estimation errors and achieving high-quality scene reconstruction with rich geometric details.

READ FULL TEXT

page 3

page 6

research
06/20/2021

NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction

We present a novel neural surface reconstruction method, called NeuS, fo...
research
06/30/2023

Neural 3D Scene Reconstruction from Multiple 2D Images without 3D Supervision

Neural 3D scene reconstruction methods have achieved impressive performa...
research
10/03/2022

Uncertainty-Driven Active Vision for Implicit Scene Reconstruction

Multi-view implicit scene reconstruction methods have become increasingl...
research
03/01/2023

P^2SDF for Neural Indoor Scene Reconstruction

Given only a set of images, neural implicit surface representation has s...
research
10/13/2022

NeuralRoom: Geometry-Constrained Neural Implicit Surfaces for Indoor Scene Reconstruction

We present a novel neural surface reconstruction method called NeuralRoo...
research
09/13/2023

Exploiting Multiple Priors for Neural 3D Indoor Reconstruction

Neural implicit modeling permits to achieve impressive 3D reconstruction...
research
01/07/2019

NVS Machines: Learning Novel View Synthesis with Fine-grained View Control

We present an approach that learns to synthesize high-quality, novel vie...

Please sign up or login with your details

Forgot password? Click here to reset