Explicit Neural Surfaces: Learning Continuous Geometry With Deformation Fields

06/05/2023
by   Thomas Walker, et al.
0

We introduce Explicit Neural Surfaces (ENS), an efficient surface reconstruction method that learns an explicitly defined continuous surface from multiple views. We use a series of neural deformation fields to progressively transform a continuous input surface to a target shape. By sampling meshes as discrete surface proxies, we train the deformation fields through efficient differentiable rasterization, and attain a mesh-independent and smooth surface representation. By using Laplace-Beltrami eigenfunctions as an intrinsic positional encoding alongside standard extrinsic Fourier features, our approach can capture fine surface details. ENS trains 1 to 2 orders of magnitude faster and can extract meshes of higher quality compared to implicit representations, whilst maintaining competitive surface reconstruction performance and real-time capabilities. Finally, we apply our approach to learn a collection of objects in a single model, and achieve disentangled interpolations between different shapes, their surface details, and textures.

READ FULL TEXT

page 2

page 6

page 8

page 14

page 15

page 16

page 17

page 20

research
12/12/2022

Transfer Learning using Spectral Convolutional Autoencoders on Semi-Regular Surface Meshes

The underlying dynamics and patterns of 3D surface meshes deforming over...
research
03/31/2021

Neural Surface Maps

Maps are arguably one of the most fundamental concepts used to define an...
research
08/24/2023

NeuralClothSim: Neural Deformation Fields Meet the Kirchhoff-Love Thin Shell Theory

Cloth simulation is an extensively studied problem, with a plethora of s...
research
07/09/2020

The Phong Surface: Efficient 3D Model Fitting using Lifted Optimization

Realtime perceptual and interaction capabilities in mixed reality requir...
research
08/10/2023

Neural Progressive Meshes

The recent proliferation of 3D content that can be consumed on hand-held...
research
06/17/2020

Pendant Drop Tensiometry: A Machine Learning Approach

Modern pendant drop tensiometry relies on numerical solution of the Youn...
research
04/08/2021

SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapes

Neural implicit surface representations have emerged as a promising para...

Please sign up or login with your details

Forgot password? Click here to reset