A curvature and density-based generative representation of shapes

09/05/2020
by   Zi Ye, et al.
0

This paper introduces a generative model for 3D surfaces based on a representation of shapes with mean curvature and metric, which are invariant under rigid transformation. Hence, compared with existing 3D machine learning frameworks, our model substantially reduces the influence of translation and rotation. In addition, the local structure of shapes will be more precisely captured, since the curvature is explicitly encoded in our model. Specifically, every surface is first conformally mapped to a canonical domain, such as a unit disk or a unit sphere. Then, it is represented by two functions: the mean curvature half-density and the vertex density, over this canonical domain. Assuming that input shapes follow a certain distribution in a latent space, we use the variational autoencoder to learn the latent space representation. After the learning, we can generate variations of shapes by randomly sampling the distribution in the latent space. Surfaces with triangular meshes can be reconstructed from the generated data by applying isotropic remeshing and spin transformation, which is given by Dirac equation. We demonstrate the effectiveness of our model on datasets of man-made and biological shapes and compare the results with other methods.

READ FULL TEXT

page 1

page 3

page 9

page 14

research
07/22/2016

Curvature transformation

A transformation based on mean curvature is introduced which morphs tria...
research
12/05/2019

Representing Closed Transformation Paths in Encoded Network Latent Space

Deep generative networks have been widely used for learning mappings fro...
research
09/08/2020

Intraoperative Liver Surface Completion with Graph Convolutional VAE

In this work we propose a method based on geometric deep learning to pre...
research
12/05/2012

A Conformal Approach for Surface Inpainting

We address the problem of surface inpainting, which aims to fill in hole...
research
10/19/2021

Momentum Contrastive Autoencoder: Using Contrastive Learning for Latent Space Distribution Matching in WAE

Wasserstein autoencoder (WAE) shows that matching two distributions is e...
research
05/27/2021

MeshCNN Fundamentals: Geometric Learning through a Reconstructable Representation

Mesh-based learning is one of the popular approaches nowadays to learn s...
research
07/20/2020

GarNet++: Improving Fast and Accurate Static3D Cloth Draping by Curvature Loss

In this paper, we tackle the problem of static 3D cloth draping on virtu...

Please sign up or login with your details

Forgot password? Click here to reset