DeepAI AI Chat
Log In Sign Up

Learning Flat Latent Manifolds with VAEs

by   Nutan Chen, et al.

Measuring the similarity between data points often requires domain knowledge. This can in parts be compensated by relying on unsupervised methods such as latent-variable models, where similarity/distance is estimated in a more compact latent space. Prevalent is the use of the Euclidean metric, which has the drawback of ignoring information about similarity of data stored in the decoder, as captured by the framework of Riemannian geometry. Alternatives—such as approximating the geodesic—are often computationally inefficient, rendering the methods impractical. We propose an extension to the framework of variational auto-encoders allows learning flat latent manifolds, where the Euclidean metric is a proxy for the similarity between data points. This is achieved by defining the latent space as a Riemannian manifold and by regularising the metric tensor to be a scaled identity matrix. Additionally, we replace the compact prior typically used in variational auto-encoders with a recently presented, more expressive hierarchical one—and formulate the learning problem as a constrained optimisation problem. We evaluate our method on a range of data-sets, including a video-tracking benchmark, where the performance of our unsupervised approach nears that of state-of-the-art supervised approaches, while retaining the computational efficiency of straight-line-based approaches.


page 5

page 6

page 7


Identifying latent distances with Finslerian geometry

Riemannian geometry provides powerful tools to explore the latent space ...

Geometry-Aware Hamiltonian Variational Auto-Encoder

Variational auto-encoders (VAEs) have proven to be a well suited tool fo...

Flat latent manifolds for music improvisation between human and machine

The use of machine learning in artistic music generation leads to contro...

Chart Auto-Encoders for Manifold Structured Data

Auto-encoding and generative models have made tremendous successes in im...

The World in a Grain of Sand: Condensing the String Vacuum Degeneracy

We propose a novel approach toward the vacuum degeneracy problem of the ...

Wrapped Distributions on homogeneous Riemannian manifolds

We provide a general framework for constructing probability distribution...

Data Generation in Low Sample Size Setting Using Manifold Sampling and a Geometry-Aware VAE

While much efforts have been focused on improving Variational Autoencode...