CITRIS: Causal Identifiability from Temporal Intervened Sequences

02/07/2022
by   Phillip Lippe, et al.
5

Understanding the latent causal factors of a dynamical system from visual observations is a crucial step towards agents reasoning in complex environments. In this paper, we propose CITRIS, a variational autoencoder framework that learns causal representations from temporal sequences of images in which underlying causal factors have possibly been intervened upon. In contrast to the recent literature, CITRIS exploits temporality and observing intervention targets to identify scalar and multidimensional causal factors, such as 3D rotation angles. Furthermore, by introducing a normalizing flow, CITRIS can be easily extended to leverage and disentangle representations obtained by already pretrained autoencoders. Extending previous results on scalar causal factors, we prove identifiability in a more general setting, in which only some components of a causal factor are affected by interventions. In experiments on 3D rendered image sequences, CITRIS outperforms previous methods on recovering the underlying causal variables. Moreover, using pretrained autoencoders, CITRIS can even generalize to unseen instantiations of causal factors, opening future research areas in sim-to-real generalization for causal representation learning.

READ FULL TEXT

page 28

page 30

page 31

page 32

page 41

page 42

06/13/2022

iCITRIS: Causal Representation Learning for Instantaneous Temporal Effects

Causal representation learning is the task of identifying the underlying...
04/18/2020

CausalVAE: Structured Causal Disentanglement in Variational Autoencoder

Learning disentanglement aims at finding a low dimensional representatio...
05/31/2023

Neuro-Causal Factor Analysis

Factor analysis (FA) is a statistical tool for studying how observed var...
03/30/2022

Weakly supervised causal representation learning

Learning high-level causal representations together with a causal model ...
02/02/2023

Disentanglement of Latent Representations via Sparse Causal Interventions

The process of generating data such as images is controlled by independe...
06/22/2022

Variational Causal Dynamics: Discovering Modular World Models from Interventions

Latent world models allow agents to reason about complex environments wi...
08/23/2023

CIParsing: Unifying Causality Properties into Multiple Human Parsing

Existing methods of multiple human parsing (MHP) apply statistical model...

Please sign up or login with your details

Forgot password? Click here to reset