STformer: A Noise-Aware Efficient Spatio-Temporal Transformer Architecture for Traffic Forecasting

12/06/2021
by   Yanjun Qin, et al.
0

Traffic forecasting plays an indispensable role in the intelligent transportation system, which makes daily travel more convenient and safer. However, the dynamic evolution of spatio-temporal correlations makes accurate traffic forecasting very difficult. Existing work mainly employs graph neural netwroks (GNNs) and deep time series models (e.g., recurrent neural networks) to capture complex spatio-temporal patterns in the dynamic traffic system. For the spatial patterns, it is difficult for GNNs to extract the global spatial information, i.e., remote sensors information in road networks. Although we can use the self-attention to extract global spatial information as in the previous work, it is also accompanied by huge resource consumption. For the temporal patterns, traffic data have not only easy-to-recognize daily and weekly trends but also difficult-to-recognize short-term noise caused by accidents (e.g., car accidents and thunderstorms). Prior traffic models are difficult to distinguish intricate temporal patterns in time series and thus hard to get accurate temporal dependence. To address above issues, we propose a novel noise-aware efficient spatio-temporal Transformer architecture for accurate traffic forecasting, named STformer. STformer consists of two components, which are the noise-aware temporal self-attention (NATSA) and the graph-based sparse spatial self-attention (GBS3A). NATSA separates the high-frequency component and the low-frequency component from the time series to remove noise and capture stable temporal dependence by the learnable filter and the temporal self-attention, respectively. GBS3A replaces the full query in vanilla self-attention with the graph-based sparse query to decrease the time and memory usage. Experiments on four real-world traffic datasets show that STformer outperforms state-of-the-art baselines with lower computational cost.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/04/2021

STJLA: A Multi-Context Aware Spatio-Temporal Joint Linear Attention Network for Traffic Forecasting

Traffic prediction has gradually attracted the attention of researchers ...
research
08/15/2021

Spatio-temporal Parking Behaviour Forecasting and Analysis Before and During COVID-19

Parking demand forecasting and behaviour analysis have received increasi...
research
12/06/2021

CDGNet: A Cross-Time Dynamic Graph-based Deep Learning Model for Traffic Forecasting

Traffic forecasting is important in intelligent transportation systems o...
research
02/20/2023

Because Every Sensor Is Unique, so Is Every Pair: Handling Dynamicity in Traffic Forecasting

Traffic forecasting is a critical task to extract values from cyber-phys...
research
03/02/2022

Parallel Spatio-Temporal Attention-Based TCN for Multivariate Time Series Prediction

As industrial systems become more complex and monitoring sensors for eve...
research
04/29/2020

A non-parametric Hawkes process model of primary and secondary accidents on a UK smart motorway

A self-exciting spatio-temporal point process is fitted to incident data...
research
10/20/2021

Learning to Remember Patterns: Pattern Matching Memory Networks for Traffic Forecasting

Traffic forecasting is a challenging problem due to complex road network...

Please sign up or login with your details

Forgot password? Click here to reset