Learning Latent Causal Dynamics

02/10/2022
by   Weiran Yao, et al.
3

One critical challenge of time-series modeling is how to learn and quickly correct the model under unknown distribution shifts. In this work, we propose a principled framework, called LiLY, to first recover time-delayed latent causal variables and identify their relations from measured temporal data under different distribution shifts. The correction step is then formulated as learning the low-dimensional change factors with a few samples from the new environment, leveraging the identified causal structure. Specifically, the framework factorizes unknown distribution shifts into transition distribution changes caused by fixed dynamics and time-varying latent causal relations, and by global changes in observation. We establish the identifiability theories of nonparametric latent causal dynamics from their nonlinear mixtures under fixed dynamics and under changes. Through experiments, we show that time-delayed latent causal influences are reliably identified from observed variables under different distribution changes. By exploiting this modular representation of changes, we can efficiently learn to correct the model under unknown distribution shifts with only a few samples.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/11/2021

Learning Temporally Causal Latent Processes from General Temporal Data

Our goal is to recover time-delayed latent causal variables and identify...
research
06/22/2022

Variational Causal Dynamics: Discovering Modular World Models from Interventions

Latent world models allow agents to reason about complex environments wi...
research
06/15/2022

Modeling the Data-Generating Process is Necessary for Out-of-Distribution Generalization

Real-world data collected from multiple domains can have multiple, disti...
research
06/23/2023

Prediction under Latent Subgroup Shifts with High-Dimensional Observations

We introduce a new approach to prediction in graphical models with laten...
research
06/04/2022

Causal Discovery in Heterogeneous Environments Under the Sparse Mechanism Shift Hypothesis

Machine learning approaches commonly rely on the assumption of independe...
research
06/30/2023

iSCAN: Identifying Causal Mechanism Shifts among Nonlinear Additive Noise Models

Structural causal models (SCMs) are widely used in various disciplines t...
research
05/13/2022

Discovering underlying dynamics in time series of networks

Understanding dramatic changes in the evolution of networks is central t...

Please sign up or login with your details

Forgot password? Click here to reset