UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstruction

04/20/2021
by   Michael Oechsle, et al.
10

Neural implicit 3D representations have emerged as a powerful paradigm for reconstructing surfaces from multi-view images and synthesizing novel views. Unfortunately, existing methods such as DVR or IDR require accurate per-pixel object masks as supervision. At the same time, neural radiance fields have revolutionized novel view synthesis. However, NeRF's estimated volume density does not admit accurate surface reconstruction. Our key insight is that implicit surface models and radiance fields can be formulated in a unified way, enabling both surface and volume rendering using the same model. This unified perspective enables novel, more efficient sampling procedures and the ability to reconstruct accurate surfaces without input masks. We compare our method on the DTU, BlendedMVS, and a synthetic indoor dataset. Our experiments demonstrate that we outperform NeRF in terms of reconstruction quality while performing on par with IDR without requiring masks.

READ FULL TEXT

page 2

page 7

page 8

page 15

page 16

page 17

page 18

page 19

research
08/15/2023

ObjectSDF++: Improved Object-Compositional Neural Implicit Surfaces

In recent years, neural implicit surface reconstruction has emerged as a...
research
08/14/2023

Color-NeuS: Reconstructing Neural Implicit Surfaces with Color

The reconstruction of object surfaces from multi-view images or monocula...
research
11/01/2021

Generative Occupancy Fields for 3D Surface-Aware Image Synthesis

The advent of generative radiance fields has significantly promoted the ...
research
06/08/2023

StreetSurf: Extending Multi-view Implicit Surface Reconstruction to Street Views

We present a novel multi-view implicit surface reconstruction technique,...
research
05/27/2023

NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Images

We present a neural rendering-based method called NeRO for reconstructin...
research
11/22/2022

Level-S^2fM: Structure from Motion on Neural Level Set of Implicit Surfaces

This paper presents a neural incremental Structure-from-Motion (SfM) app...
research
05/25/2022

Neural 3D Reconstruction in the Wild

We are witnessing an explosion of neural implicit representations in com...

Please sign up or login with your details

Forgot password? Click here to reset