Autoregressive GNN-ODE GRU Model for Network Dynamics

11/19/2022
by   Bo Liang, et al.
0

Revealing the continuous dynamics on the networks is essential for understanding, predicting, and even controlling complex systems, but it is hard to learn and model the continuous network dynamics because of complex and unknown governing equations, high dimensions of complex systems, and unsatisfactory observations. Moreover, in real cases, observed time-series data are usually non-uniform and sparse, which also causes serious challenges. In this paper, we propose an Autoregressive GNN-ODE GRU Model (AGOG) to learn and capture the continuous network dynamics and realize predictions of node states at an arbitrary time in a data-driven manner. The GNN module is used to model complicated and nonlinear network dynamics. The hidden state of node states is specified by the ODE system, and the augmented ODE system is utilized to map the GNN into the continuous time domain. The hidden state is updated through GRUCell by observations. As prior knowledge, the true observations at the same timestamp are combined with the hidden states for the next prediction. We use the autoregressive model to make a one-step ahead prediction based on observation history. The prediction is achieved by solving an initial-value problem for ODE. To verify the performance of our model, we visualize the learned dynamics and test them in three tasks: interpolation reconstruction, extrapolation prediction, and regular sequences prediction. The results demonstrate that our model can capture the continuous dynamic process of complex systems accurately and make precise predictions of node states with minimal error. Our model can consistently outperform other baselines or achieve comparable performance.

READ FULL TEXT

page 7

page 8

research
06/11/2020

Learning Continuous-Time Dynamics by Stochastic Differential Networks

Learning continuous-time stochastic dynamics from sparse or irregular ob...
research
11/08/2020

Learning Continuous System Dynamics from Irregularly-Sampled Partial Observations

Many real-world systems, such as moving planets, can be considered as mu...
research
01/18/2020

Inference for Network Structure and Dynamics from Time Series Data via Graph Neural Network

Network structures in various backgrounds play important roles in social...
research
03/12/2018

Learning unknown ODE models with Gaussian processes

In conventional ODE modelling coefficients of an equation driving the sy...
research
07/27/2017

Recursive Variational Bayesian Dual Estimation for Nonlinear Dynamics and Non-Gaussian Observations

State space models provide an interpretable framework for complex time s...
research
11/16/2021

Switching Recurrent Kalman Networks

Forecasting driving behavior or other sensor measurements is an essentia...
research
07/22/2018

Learning Deep Hidden Nonlinear Dynamics from Aggregate Data

Learning nonlinear dynamics from diffusion data is a challenging problem...

Please sign up or login with your details

Forgot password? Click here to reset