LIMP: Learning Latent Shape Representations with Metric Preservation Priors

03/27/2020
by   Luca Cosmo, et al.
0

In this paper, we advocate the adoption of metric preservation as a powerful prior for learning latent representations of deformable 3D shapes. Key to our construction is the introduction of a geometric distortion criterion, defined directly on the decoded shapes, translating the preservation of the metric on the decoding to the formation of linear paths in the underlying latent space. Our rationale lies in the observation that training samples alone are often insufficient to endow generative models with high fidelity, motivating the need for large training datasets. In contrast, metric preservation provides a rigorous way to control the amount of geometric distortion incurring in the construction of the latent space, leading in turn to synthetic samples of higher quality. We further demonstrate, for the first time, the adoption of differentiable intrinsic distances in the backpropagation of a geodesic loss. Our geometric priors are particularly relevant in the presence of scarce training data, where learning any meaningful latent structure can be especially challenging. The effectiveness and potential of our generative model is showcased in applications of style transfer, content generation, and shape completion.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/20/2022

Identifying latent distances with Finslerian geometry

Riemannian geometry provides powerful tools to explore the latent space ...
research
08/18/2019

Geometric Disentanglement for Generative Latent Shape Models

Representing 3D shape is a fundamental problem in artificial intelligenc...
research
03/09/2021

A prior-based approximate latent Riemannian metric

Stochastic generative models enable us to capture the geometric structur...
research
02/27/2021

Disentangling Geometric Deformation Spaces in Generative Latent Shape Models

A complete representation of 3D objects requires characterizing the spac...
research
12/06/2018

Self-supervised Learning of Dense Shape Correspondence

We introduce the first completely unsupervised correspondence learning a...
research
05/26/2022

Analyzing the Latent Space of GAN through Local Dimension Estimation

The impressive success of style-based GANs (StyleGANs) in high-fidelity ...
research
11/20/2019

DR-KFD: A Differentiable Visual Metric for 3D Shape Reconstruction

We advocate the use of differential visual shape metrics to train deep n...

Please sign up or login with your details

Forgot password? Click here to reset