Temporal Tensor Transformation Network for Multivariate Time Series Prediction

01/04/2020
by   Yuya Jeremy Ong, et al.
25

Multivariate time series prediction has applications in a wide variety of domains and is considered to be a very challenging task, especially when the variables have correlations and exhibit complex temporal patterns, such as seasonality and trend. Many existing methods suffer from strong statistical assumptions, numerical issues with high dimensionality, manual feature engineering efforts, and scalability. In this work, we present a novel deep learning architecture, known as Temporal Tensor Transformation Network, which transforms the original multivariate time series into a higher order of tensor through the proposed Temporal-Slicing Stack Transformation. This yields a new representation of the original multivariate time series, which enables the convolution kernel to extract complex and non-linear features as well as variable interactional signals from a relatively large temporal region. Experimental results show that Temporal Tensor Transformation Network outperforms several state-of-the-art methods on window-based predictions across various tasks. The proposed architecture also demonstrates robust prediction performance through an extensive sensitivity analysis.

READ FULL TEXT

page 1

page 3

page 4

page 8

research
03/22/2023

Conformal Prediction for Time Series with Modern Hopfield Networks

To quantify uncertainty, conformal prediction methods are gaining contin...
research
06/02/2018

Hierarchical Attention-Based Recurrent Highway Networks for Time Series Prediction

Time series prediction has been studied in a variety of domains. However...
research
03/14/2023

Understanding Model Complexity for temporal tabular and multi-variate time series, case study with Numerai data science tournament

In this paper, we explore the use of different feature engineering and d...
research
01/24/2023

Neuronal architecture extracts statistical temporal patterns

Neuronal systems need to process temporal signals. We here show how high...
research
10/19/2022

Geostatistics in the presence of multivariate complexities: comparison of multi-Gaussian transforms

Geostatistical simulation of two or more continuous variables is a commo...
research
10/28/2015

Linear-time Detection of Non-linear Changes in Massively High Dimensional Time Series

Change detection in multivariate time series has applications in many do...
research
11/09/2019

XceptionTime: A Novel Deep Architecture based on Depthwise Separable Convolutions for Hand Gesture Classification

Capitalizing on the need for addressing the existing challenges associat...

Please sign up or login with your details

Forgot password? Click here to reset