Temporal Graph Neural Networks for Irregular Data

02/16/2023
by   Joel Oskarsson, et al.
0

This paper proposes a temporal graph neural network model for forecasting of graph-structured irregularly observed time series. Our TGNN4I model is designed to handle both irregular time steps and partial observations of the graph. This is achieved by introducing a time-continuous latent state in each node, following a linear Ordinary Differential Equation (ODE) defined by the output of a Gated Recurrent Unit (GRU). The ODE has an explicit solution as a combination of exponential decay and periodic dynamics. Observations in the graph neighborhood are taken into account by integrating graph neural network layers in both the GRU state update and predictive model. The time-continuous dynamics additionally enable the model to make predictions at arbitrary time steps. We propose a loss function that leverages this and allows for training the model for forecasting over different time horizons. Experiments on simulated data and real-world data from traffic and climate modeling validate the usefulness of both the graph structure and time-continuous dynamics in settings with irregular observations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/29/2019

GRU-ODE-Bayes: Continuous modeling of sporadically-observed time series

Modeling real-world multidimensional time series can be particularly cha...
research
11/22/2021

Modeling Irregular Time Series with Continuous Recurrent Units

Recurrent neural networks (RNNs) like long short-term memory networks (L...
research
11/08/2020

Learning Continuous System Dynamics from Irregularly-Sampled Partial Observations

Many real-world systems, such as moving planets, can be considered as mu...
research
04/02/2021

Surfacing Estimation Uncertainty in the Decay Parameters of Hawkes Processes with Exponential Kernels

As a tool for capturing irregular temporal dependencies (rather than res...
research
01/13/2021

Temporal Knowledge Graph Forecasting with Neural ODE

Learning node representation on dynamically-evolving, multi-relational g...
research
04/14/2023

Continuous time recurrent neural networks: overview and application to forecasting blood glucose in the intensive care unit

Irregularly measured time series are common in many of the applied setti...
research
10/19/2022

Irregularly-Sampled Time Series Modeling with Spline Networks

Observations made in continuous time are often irregular and contain the...

Please sign up or login with your details

Forgot password? Click here to reset