Forecaster: A Graph Transformer for Forecasting Spatial and Time-Dependent Data

09/09/2019
by   Yang Li, et al.
17

Spatial and time-dependent data is of interest in many applications. This task is difficult due to its complex spatial dependency, long-range temporal dependency, data non-stationarity, and data heterogeneity. To address these challenges, we propose Forecaster, a graph Transformer architecture. Specifically, we start by learning the structure of the graph that parsimoniously represents the spatial dependency between the data at different locations. Based on the topology of the graph, we sparsify the Transformer to account for the strength of spatial dependency, long-range temporal dependency, data non-stationarity, and data heterogeneity. We evaluate Forecaster in the problem of forecasting taxi ride-hailing demand and show that our proposed architecture significantly outperforms the state-of-the-art baselines.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/06/2017

Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting

Spatiotemporal forecasting has various applications in neuroscience, cli...
research
02/13/2023

One Transformer for All Time Series: Representing and Training with Time-Dependent Heterogeneous Tabular Data

There is a recent growing interest in applying Deep Learning techniques ...
research
06/07/2022

Spatial-Temporal Adaptive Graph Convolution with Attention Network for Traffic Forecasting

Traffic forecasting is one canonical example of spatial-temporal learnin...
research
04/09/2021

Deep Transformer Networks for Time Series Classification: The NPP Safety Case

A challenging part of dynamic probabilistic risk assessment for nuclear ...
research
10/31/2022

Spatial-Temporal Synchronous Graph Transformer network (STSGT) for COVID-19 forecasting

COVID-19 has become a matter of serious concern over the last few years....
research
09/24/2021

Long-Range Transformers for Dynamic Spatiotemporal Forecasting

Multivariate Time Series Forecasting (TSF) focuses on the prediction of ...
research
01/20/2019

Visualizing Semantic Structures of Sequential Data by Learning Temporal Dependencies

While conventional methods for sequential learning focus on interaction ...

Please sign up or login with your details

Forgot password? Click here to reset