DeepAI AI Chat
Log In Sign Up

Geodesic Clustering in Deep Generative Models

by   Tao Yang, et al.
English 设为首页

Deep generative models are tremendously successful in learning low-dimensional latent representations that well-describe the data. These representations, however, tend to much distort relationships between points, i.e. pairwise distances tend to not reflect semantic similarities well. This renders unsupervised tasks, such as clustering, difficult when working with the latent representations. We demonstrate that taking the geometry of the generative model into account is sufficient to make simple clustering algorithms work well over latent representations. Leaning on the recent finding that deep generative models constitute stochastically immersed Riemannian manifolds, we propose an efficient algorithm for computing geodesics (shortest paths) and computing distances in the latent space, while taking its distortion into account. We further propose a new architecture for modeling uncertainty in variational autoencoders, which is essential for understanding the geometry of deep generative models. Experiments show that the geodesic distance is very likely to reflect the internal structure of the data.


page 5

page 6

page 7

page 8

page 9

page 10


Geometry of Deep Generative Models for Disentangled Representations

Deep generative models like variational autoencoders approximate the int...

MPCC: Matching Priors and Conditionals for Clustering

Clustering is a fundamental task in unsupervised learning that depends h...

Learning Latent Subspaces in Variational Autoencoders

Variational autoencoders (VAEs) are widely used deep generative models c...

Fast and Robust Shortest Paths on Manifolds Learned from Data

We propose a fast, simple and robust algorithm for computing shortest pa...

Fast Approximate Geodesics for Deep Generative Models

The length of the geodesic between two data points along the Riemannian ...

Deep Generative Endmember Modeling: An Application to Unsupervised Spectral Unmixing

Endmember (EM) spectral variability can greatly impact the performance o...