NeuralUDF: Learning Unsigned Distance Fields for Multi-view Reconstruction of Surfaces with Arbitrary Topologies

11/25/2022
by   Xiaoxiao Long, et al.
0

We present a novel method, called NeuralUDF, for reconstructing surfaces with arbitrary topologies from 2D images via volume rendering. Recent advances in neural rendering based reconstruction have achieved compelling results. However, these methods are limited to objects with closed surfaces since they adopt Signed Distance Function (SDF) as surface representation which requires the target shape to be divided into inside and outside. In this paper, we propose to represent surfaces as the Unsigned Distance Function (UDF) and develop a new volume rendering scheme to learn the neural UDF representation. Specifically, a new density function that correlates the property of UDF with the volume rendering scheme is introduced for robust optimization of the UDF fields. Experiments on the DTU and DeepFashion3D datasets show that our method not only enables high-quality reconstruction of non-closed shapes with complex typologies, but also achieves comparable performance to the SDF based methods on the reconstruction of closed surfaces.

READ FULL TEXT

page 6

page 7

page 8

page 14

page 15

page 16

research
06/20/2021

NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction

We present a novel neural surface reconstruction method, called NeuS, fo...
research
03/27/2023

NeUDF: Learning Unsigned Distance Fields from Multi-view Images for Reconstructing Non-watertight Models

Volume rendering-based 3D reconstruction from multi-view images has gain...
research
12/15/2019

SDFDiff: Differentiable Rendering of Signed Distance Fields for 3D Shape Optimization

We propose SDFDiff, a novel approach for image-based shape optimization ...
research
09/16/2023

Surface Extraction from Neural Unsigned Distance Fields

We propose a method, named DualMesh-UDF, to extract a surface from unsig...
research
06/22/2021

Volume Rendering of Neural Implicit Surfaces

Neural volume rendering became increasingly popular recently due to its ...
research
08/19/2021

Learning Anchored Unsigned Distance Functions with Gradient Direction Alignment for Single-view Garment Reconstruction

While single-view 3D reconstruction has made significant progress benefi...
research
03/20/2023

NeTO:Neural Reconstruction of Transparent Objects with Self-Occlusion Aware Refraction-Tracing

We present a novel method, called NeTO, for capturing 3D geometry of sol...

Please sign up or login with your details

Forgot password? Click here to reset