Toward Mesh-Invariant 3D Generative Deep Learning with Geometric Measures

06/27/2023
by   Thomas Besnier, et al.
0

3D generative modeling is accelerating as the technology allowing the capture of geometric data is developing. However, the acquired data is often inconsistent, resulting in unregistered meshes or point clouds. Many generative learning algorithms require correspondence between each point when comparing the predicted shape and the target shape. We propose an architecture able to cope with different parameterizations, even during the training phase. In particular, our loss function is built upon a kernel-based metric over a representation of meshes using geometric measures such as currents and varifolds. The latter allows to implement an efficient dissimilarity measure with many desirable properties such as robustness to resampling of the mesh or point cloud. We demonstrate the efficiency and resilience of our model with a generative learning task of human faces.

READ FULL TEXT

page 3

page 19

page 20

page 21

page 23

page 24

page 25

page 27

research
08/30/2015

Spherical Conformal Parameterization of Genus-0 Point Clouds for Meshing

Point cloud is the most fundamental representation of 3D geometric objec...
research
04/29/2021

MongeNet: Efficient Sampler for Geometric Deep Learning

Recent advances in geometric deep-learning introduce complex computation...
research
10/11/2021

BuildingNet: Learning to Label 3D Buildings

We introduce BuildingNet: (a) a large-scale dataset of 3D building model...
research
03/14/2023

MeshDiffusion: Score-based Generative 3D Mesh Modeling

We consider the task of generating realistic 3D shapes, which is useful ...
research
07/16/2020

Accelerating 3D Deep Learning with PyTorch3D

Deep learning has significantly improved 2D image recognition. Extending...
research
08/15/2021

U-mesh: Human Correspondence Matching with Mesh Convolutional Networks

The proliferation of 3D scanning technology has driven a need for method...
research
04/20/2021

Geometric Deep Learning on Anatomical Meshes for the Prediction of Alzheimer's Disease

Geometric deep learning can find representations that are optimal for a ...

Please sign up or login with your details

Forgot password? Click here to reset