Spatiotemporal Attention for Multivariate Time Series Prediction and Interpretation

08/11/2020
by   Tryambak Gangopadhyay, et al.
53

Multivariate time series modeling and prediction problems are abundant in many machine learning application domains. Accurate interpretation of such prediction outcomes from a machine learning model that explicitly captures temporal correlations can be a major benefit to the domain experts. In this context, temporal attention has been successfully applied to isolate the important time steps for the input time series. However, in multivariate time series problems, spatial interpretation is also critical to understand the contributions of different variables on the model outputs. We propose a novel deep learning architecture, called spatiotemporal attention mechanism (STAM) for simultaneous learning of the most important time steps and variables. STAM is a causal (i.e., only depends on past inputs and does not use future inputs) and scalable (i.e., scales well with an increase in the number of variables) approach that is comparable to the state-of-the-art models in terms of computational tractability. We demonstrate the performance of our models both on a popular public dataset as well as on a domain-specific dataset. When compared with the baseline models, the results show that STAM maintains state-of-the-art prediction accuracy while offering the benefit of accurate spatiotemporal interpretability. We validate the learned attention weights from a domain knowledge perspective for the real-world datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/22/2023

Conformal Prediction for Time Series with Modern Hopfield Networks

To quantify uncertainty, conformal prediction methods are gaining contin...
research
05/25/2022

TSEM: Temporally Weighted Spatiotemporal Explainable Neural Network for Multivariate Time Series

Deep learning has become a one-size-fits-all solution for technical and ...
research
09/19/2017

A textual transform of multivariate time-series for prognostics

Prognostics or early detection of incipient faults is an important indus...
research
10/18/2022

Optimal Event Monitoring through Internet Mashup over Multivariate Time Series

We propose a Web-Mashup Application Service Framework for Multivariate T...
research
02/08/2022

A multivariate pseudo-likelihood approach to estimating directional ocean wave models

Ocean buoy data in the form of high frequency multivariate time series a...
research
07/03/2021

Spatiotemporal convolutional network for time-series prediction and causal inference

Making predictions in a robust way is not easy for nonlinear systems. In...
research
04/04/2022

Taking ROCKET on an Efficiency Mission: Multivariate Time Series Classification with LightWaveS

Nowadays, with the rising number of sensors in sectors such as healthcar...

Please sign up or login with your details

Forgot password? Click here to reset