Long-term series forecasting with Query Selector

07/28/2021
by   Marek Klimek, et al.
1

Various modifications of TRANSFORMER were recently used to solve time-series forecasting problem. We propose Query Selector - an efficient, deterministic algorithm for sparse attention matrix. Experiments show it achieves state-of-the art results on ETT data set.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/19/2021

Long-term series forecasting with Query Selector – efficient model of sparse attention

Various modifications of TRANSFORMER were recently used to solve time-se...
research
05/26/2022

Are Transformers Effective for Time Series Forecasting?

Recently, there has been a surge of Transformer-based solutions for the ...
research
01/16/2023

TDSTF: Transformer-based Diffusion probabilistic model for Sparse Time series Forecasting

Time series probabilistic forecasting with multi-dimensional and sporadi...
research
07/13/2023

MPR-Net:Multi-Scale Pattern Reproduction Guided Universality Time Series Interpretable Forecasting

Time series forecasting has received wide interest from existing researc...
research
02/23/2022

A Differential Attention Fusion Model Based on Transformer for Time Series Forecasting

Time series forecasting is widely used in the fields of equipment life c...
research
06/08/2023

Does Long-Term Series Forecasting Need Complex Attention and Extra Long Inputs?

As Transformer-based models have achieved impressive performance on vari...
research
03/18/2018

Aggregating Strategies for Long-term Forecasting

The article is devoted to investigating the application of aggregating a...

Please sign up or login with your details

Forgot password? Click here to reset