Learning Latent Subspaces in Variational Autoencoders

12/14/2018
by   Jack Klys, et al.
0

Variational autoencoders (VAEs) are widely used deep generative models capable of learning unsupervised latent representations of data. Such representations are often difficult to interpret or control. We consider the problem of unsupervised learning of features correlated to specific labels in a dataset. We propose a VAE-based generative model which we show is capable of extracting features correlated to binary labels in the data and structuring it in a latent subspace which is easy to interpret. Our model, the Conditional Subspace VAE (CSVAE), uses mutual information minimization to learn a low-dimensional latent subspace associated with each label that can easily be inspected and independently manipulated. We demonstrate the utility of the learned representations for attribute manipulation tasks on both the Toronto Face and CelebA datasets.

READ FULL TEXT

page 5

page 6

page 8

page 13

page 14

page 15

research
09/13/2018

Geodesic Clustering in Deep Generative Models

Deep generative models are tremendously successful in learning low-dimen...
research
02/09/2020

Out-of-Distribution Detection with Distance Guarantee in Deep Generative Models

Recent research has shown that it is challenging to detect out-of-distri...
research
11/28/2022

Chroma-VAE: Mitigating Shortcut Learning with Generative Classifiers

Deep neural networks are susceptible to shortcut learning, using simple ...
research
08/03/2020

IntroVAC: Introspective Variational Classifiers for Learning Interpretable Latent Subspaces

Learning useful representations of complex data has been the subject of ...
research
05/10/2018

Unsupervised Deep Representations for Learning Audience Facial Behaviors

In this paper, we present an unsupervised learning approach for analyzin...
research
09/09/2020

Multilinear Latent Conditioning for Generating Unseen Attribute Combinations

Deep generative models rely on their inductive bias to facilitate genera...
research
10/26/2020

Robust Disentanglement of a Few Factors at a Time

Disentanglement is at the forefront of unsupervised learning, as disenta...

Please sign up or login with your details

Forgot password? Click here to reset