Learning Temporally Causal Latent Processes from General Temporal Data

10/11/2021
by   Weiran Yao, et al.
0

Our goal is to recover time-delayed latent causal variables and identify their relations from measured temporal data. Estimating causally-related latent variables from observations is particularly challenging as the latent variables are not uniquely recoverable in the most general case. In this work, we consider both a nonparametric, nonstationary setting and a parametric setting for the latent processes and propose two provable conditions under which temporally causal latent processes can be identified from their nonlinear mixtures. We propose LEAP, a theoretically-grounded architecture that extends Variational Autoencoders (VAEs) by enforcing our conditions through proper constraints in causal process prior. Experimental results on various data sets demonstrate that temporally causal latent processes are reliably identified from observed variables under different dependency structures and that our approach considerably outperforms baselines that do not leverage history or nonstationarity information. This is one of the first works that successfully recover time-delayed latent processes from nonlinear mixtures without using sparsity or minimality assumptions.

READ FULL TEXT

page 8

page 9

research
03/20/2013

Detecting Causal Relations in the Presence of Unmeasured Variables

The presence of latent variables can greatly complicate inferences about...
research
02/10/2022

Learning Latent Causal Dynamics

One critical challenge of time-series modeling is how to learn and quick...
research
06/29/2021

Learning latent causal graphs via mixture oracles

We study the problem of reconstructing a causal graphical model from dat...
research
05/26/2023

Causal Component Analysis

Independent Component Analysis (ICA) aims to recover independent latent ...
research
01/14/2020

Disentanglement by Nonlinear ICA with General Incompressible-flow Networks (GIN)

A central question of representation learning asks under which condition...
research
02/27/2017

Learning Vector Autoregressive Models with Latent Processes

We study the problem of learning the support of transition matrix betwee...
research
09/18/2020

Causal Clustering for 1-Factor Measurement Models on Data with Various Types

The tetrad constraint is a condition of which the satisfaction signals a...

Please sign up or login with your details

Forgot password? Click here to reset