Learning Signed Distance Field for Multi-view Surface Reconstruction

08/23/2021
by   Jingyang Zhang, et al.
9

Recent works on implicit neural representations have shown promising results for multi-view surface reconstruction. However, most approaches are limited to relatively simple geometries and usually require clean object masks for reconstructing complex and concave objects. In this work, we introduce a novel neural surface reconstruction framework that leverages the knowledge of stereo matching and feature consistency to optimize the implicit surface representation. More specifically, we apply a signed distance field (SDF) and a surface light field to represent the scene geometry and appearance respectively. The SDF is directly supervised by geometry from stereo matching, and is refined by optimizing the multi-view feature consistency and the fidelity of rendered images. Our method is able to improve the robustness of geometry estimation and support reconstruction of complex scene topologies. Extensive experiments have been conducted on DTU, EPFL and Tanks and Temples datasets. Compared to previous state-of-the-art methods, our method achieves better mesh reconstruction in wide open scenes without masks as input.

READ FULL TEXT

page 1

page 3

page 5

page 7

page 8

page 13

page 14

page 15

research
02/28/2023

Dynamic Multi-View Scene Reconstruction Using Neural Implicit Surface

Reconstructing general dynamic scenes is important for many computer vis...
research
06/07/2022

Critical Regularizations for Neural Surface Reconstruction in the Wild

Neural implicit functions have recently shown promising results on surfa...
research
05/05/2022

Neural 3D Scene Reconstruction with the Manhattan-world Assumption

This paper addresses the challenge of reconstructing 3D indoor scenes fr...
research
09/17/2022

Neural Implicit Surface Reconstruction using Imaging Sonar

We present a technique for dense 3D reconstruction of objects using an i...
research
07/20/2022

2D GANs Meet Unsupervised Single-view 3D Reconstruction

Recent research has shown that controllable image generation based on pr...
research
06/16/2023

C2F2NeUS: Cascade Cost Frustum Fusion for High Fidelity and Generalizable Neural Surface Reconstruction

There is an emerging effort to combine the two popular technical paths, ...
research
12/05/2021

Implicit Neural Deformation for Multi-View Face Reconstruction

In this work, we present a new method for 3D face reconstruction from mu...

Please sign up or login with your details

Forgot password? Click here to reset