Disentangling Factors of Variation with Cycle-Consistent Variational Auto-Encoders

04/27/2018
by   Ananya Harsh Jha, et al.
0

Generative models that learn disentangled representations for different factors of variation in an image can be very useful for targeted data augmentation. By sampling from the disentangled latent subspace of interest, we can efficiently generate new data necessary for a particular task. Learning disentangled representations is a challenging problem, especially when certain factors of variation are difficult to label. In this paper, we introduce a novel architecture that disentangles the latent space into two complementary subspaces by using only weak supervision in form of pairwise similarity labels. Inspired by the recent success of cycle-consistent adversarial architectures, we use cycle-consistency in a variational auto-encoder framework. Our non-adversarial approach is in contrast with the recent works that combine adversarial training with auto-encoders to disentangle representations. We show compelling results of disentangled latent subspaces on three datasets and compare with recent works that leverage adversarial training.

READ FULL TEXT

page 3

page 8

page 12

page 13

page 14

research
10/19/2022

DOT-VAE: Disentangling One Factor at a Time

As we enter the era of machine learning characterized by an overabundanc...
research
04/05/2022

Lost in Latent Space: Disentangled Models and the Challenge of Combinatorial Generalisation

Recent research has shown that generative models with highly disentangle...
research
11/15/2017

DNA-GAN: Learning Disentangled Representations from Multi-Attribute Images

Disentangling factors of variation has always been a challenging problem...
research
03/04/2021

There and back again: Cycle consistency across sets for isolating factors of variation

Representational learning hinges on the task of unraveling the set of un...
research
05/17/2022

How do Variational Autoencoders Learn? Insights from Representational Similarity

The ability of Variational Autoencoders (VAEs) to learn disentangled rep...
research
11/25/2021

Learning Conditional Invariance through Cycle Consistency

Identifying meaningful and independent factors of variation in a dataset...
research
06/04/2022

Learning Generative Factors of Neuroimaging Data with Variational auto-encoders

Neuroimaging techniques produce high-dimensional, stochastic data from w...

Please sign up or login with your details

Forgot password? Click here to reset