On the Transfer of Disentangled Representations in Realistic Settings

10/27/2020
by   Andrea Dittadi, et al.
24

Learning meaningful representations that disentangle the underlying structure of the data generating process is considered to be of key importance in machine learning. While disentangled representations were found to be useful for diverse tasks such as abstract reasoning and fair classification, their scalability and real-world impact remain questionable. We introduce a new high-resolution dataset with 1M simulated images and over 1,800 annotated real-world images of the same robotic setup. In contrast to previous work, this new dataset exhibits correlations, a complex underlying structure, and allows to evaluate transfer to unseen simulated and real-world settings where the encoder i) remains in distribution or ii) is out of distribution. We propose new architectures in order to scale disentangled representation learning to realistic high-resolution settings and conduct a large-scale empirical study of disentangled representations on this dataset. We observe that disentanglement is a good predictor for out-of-distribution (OOD) task performance.

READ FULL TEXT

page 2

page 6

page 18

page 22

page 23

page 25

page 26

page 27

research
05/29/2019

Are Disentangled Representations Helpful for Abstract Visual Reasoning?

A disentangled representation encodes information about the salient fact...
research
03/06/2020

Semi-Supervised StyleGAN for Disentanglement Learning

Disentanglement learning is crucial for obtaining disentangled represent...
research
06/07/2019

On the Transfer of Inductive Bias from Simulation to the Real World: a New Disentanglement Dataset

Learning meaningful and compact representations with structurally disent...
research
02/07/2020

Weakly-Supervised Disentanglement Without Compromises

Intelligent agents should be able to learn useful representations by obs...
research
08/26/2021

A Tutorial on Learning Disentangled Representations in the Imaging Domain

Disentangled representation learning has been proposed as an approach to...
research
01/18/2021

Hierarchical disentangled representation learning for singing voice conversion

Conventional singing voice conversion (SVC) methods often suffer from op...
research
12/06/2019

Achieving Robustness in the Wild via Adversarial Mixing with Disentangled Representations

Recent research has made the surprising finding that state-of-the-art de...

Please sign up or login with your details

Forgot password? Click here to reset