SuperUDF: Self-supervised UDF Estimation for Surface Reconstruction

08/28/2023
by   Hui Tian, et al.
0

Learning-based surface reconstruction based on unsigned distance functions (UDF) has many advantages such as handling open surfaces. We propose SuperUDF, a self-supervised UDF learning which exploits a learned geometry prior for efficient training and a novel regularization for robustness to sparse sampling. The core idea of SuperUDF draws inspiration from the classical surface approximation operator of locally optimal projection (LOP). The key insight is that if the UDF is estimated correctly, the 3D points should be locally projected onto the underlying surface following the gradient of the UDF. Based on that, a number of inductive biases on UDF geometry and a pre-learned geometry prior are devised to learn UDF estimation efficiently. A novel regularization loss is proposed to make SuperUDF robust to sparse sampling. Furthermore, we also contribute a learning-based mesh extraction from the estimated UDFs. Extensive evaluations demonstrate that SuperUDF outperforms the state of the arts on several public datasets in terms of both quality and efficiency. Code will be released after accteptance.

READ FULL TEXT

page 1

page 7

page 8

page 10

page 11

page 14

research
07/12/2023

SC-NeuS: Consistent Neural Surface Reconstruction from Sparse and Noisy Views

The recent neural surface reconstruction by volume rendering approaches ...
research
08/18/2021

Deep Hybrid Self-Prior for Full 3D Mesh Generation

We present a deep learning pipeline that leverages network self-prior to...
research
10/26/2022

Automated Reconstruction of 3D Open Surfaces from Sparse Point Clouds

Real-world 3D data may contain intricate details defined by salient surf...
research
11/29/2021

MeshUDF: Fast and Differentiable Meshing of Unsigned Distance Field Networks

Recent work modelling 3D open surfaces train deep neural networks to app...
research
02/19/2023

Self-supervised Cloth Reconstruction via Action-conditioned Cloth Tracking

State estimation is one of the greatest challenges for cloth manipulatio...
research
09/16/2023

Surface Extraction from Neural Unsigned Distance Fields

We propose a method, named DualMesh-UDF, to extract a surface from unsig...
research
10/19/2020

Freetures: Localization in Signed Distance Function Maps

Localization of a robotic system within a previously mapped environment ...

Please sign up or login with your details

Forgot password? Click here to reset