CF-VAE: Causal Disentangled Representation Learning with VAE and Causal Flows

04/18/2023
by   Di Fan, et al.
0

Learning disentangled representations is important in representation learning, aiming to learn a low dimensional representation of data where each dimension corresponds to one underlying generative factor. Due to the possibility of causal relationships between generative factors, causal disentangled representation learning has received widespread attention. In this paper, we first propose new flows that can incorporate causal structure information into the model, called causal flows. Based on the variational autoencoders(VAE) commonly used in disentangled representation learning, we design a new model, CF-VAE, which enhances the disentanglement ability of the VAE encoder by utilizing the causal flows. By further introducing the supervision of ground-truth factors, we demonstrate the disentanglement identifiability of our model. Experimental results on both synthetic and real datasets show that CF-VAE can achieve causal disentanglement and perform intervention experiments. Moreover, CF-VAE exhibits outstanding performance on downstream tasks and has the potential to learn causal structure among factors.

READ FULL TEXT

page 8

page 9

research
06/02/2023

Learning Causally Disentangled Representations via the Principle of Independent Causal Mechanisms

Learning disentangled causal representations is a challenging problem th...
research
04/18/2020

CausalVAE: Structured Causal Disentanglement in Variational Autoencoder

Learning disentanglement aims at finding a low dimensional representatio...
research
09/08/2021

Desiderata for Representation Learning: A Causal Perspective

Representation learning constructs low-dimensional representations to su...
research
08/08/2022

Interpretable Disentangled Parametrization of Measured BRDF with β-VAE

Finding a low dimensional parametric representation of measured BRDF rem...
research
06/12/2020

LaRVAE: Label Replacement VAE for Semi-Supervised Disentanglement Learning

Learning interpretable and disentangled representations is a crucial yet...
research
08/22/2020

WeLa-VAE: Learning Alternative Disentangled Representations Using Weak Labels

Learning disentangled representations without supervision or inductive b...
research
02/05/2019

Relevance Factor VAE: Learning and Identifying Disentangled Factors

We propose a novel VAE-based deep auto-encoder model that can learn dise...

Please sign up or login with your details

Forgot password? Click here to reset