Learning Deep Hidden Nonlinear Dynamics from Aggregate Data

07/22/2018
by   Yisen Wang, et al.
0

Learning nonlinear dynamics from diffusion data is a challenging problem since the individuals observed may be different at different time points, generally following an aggregate behaviour. Existing work cannot handle the tasks well since they model such dynamics either directly on observations or enforce the availability of complete longitudinal individual-level trajectories. However, in most of the practical applications, these requirements are unrealistic: the evolving dynamics may be too complex to be modeled directly on observations, and individual-level trajectories may not be available due to technical limitations, experimental costs and/or privacy issues. To address these challenges, we formulate a model of diffusion dynamics as the hidden stochastic process via the introduction of hidden variables for flexibility, and learn the hidden dynamics directly on aggregate observations without any requirement for individual-level trajectories. We propose a dynamic generative model with Wasserstein distance for LEarninG dEep hidden Nonlinear Dynamics (LEGEND) and prove its theoretical guarantees as well. Experiments on a range of synthetic and real-world datasets illustrate that LEGEND has very strong performance compared to state-of-the-art baselines.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/10/2020

Learning Stochastic Behaviour of Aggregate Data

Learning nonlinear dynamics of aggregate data is a challenging problem s...
research
11/23/2020

Learning Hidden Markov Models from Aggregate Observations

In this paper, we propose an algorithm for estimating the parameters of ...
research
03/04/2023

Estimating Treatment Effects from Irregular Time Series Observations with Hidden Confounders

Causal analysis for time series data, in particular estimating individua...
research
09/06/2022

Weak Collocation Regression method: fast reveal hidden stochastic dynamics from high-dimensional aggregate data

Revealing hidden dynamics from the stochastic data is a challenging prob...
research
12/01/2020

Deep dynamic modeling with just two time points: Can we still allow for individual trajectories?

Longitudinal biomedical data are often characterized by a sparse time gr...
research
02/11/2022

Bounded nonlinear forecasts of partially observed geophysical systems with physics-constrained deep learning

The complexity of real-world geophysical systems is often compounded by ...
research
11/19/2022

Autoregressive GNN-ODE GRU Model for Network Dynamics

Revealing the continuous dynamics on the networks is essential for under...

Please sign up or login with your details

Forgot password? Click here to reset