Adjusting for Autocorrelated Errors in Neural Networks for Time Series Regression and Forecasting

by   Fan-Keng Sun, et al.

In many cases, it is difficult to generate highly accurate models for time series data using a known parametric model structure. In response, an increasing body of research focuses on using neural networks to model time series approximately. A common assumption in training neural networks on time series is that the errors at different time steps are uncorrelated. However, due to the temporality of the data, errors are actually autocorrelated in many cases, which makes such maximum likelihood estimation inaccurate. In this paper, we propose to learn the autocorrelation coefficient jointly with the model parameters in order to adjust for autocorrelated errors. For time series regression, large-scale experiments indicate that our method outperforms the Prais-Winsten method, especially when the autocorrelation is strong. Furthermore, we broaden our method to time series forecasting and apply it with various state-of-the-art models. Results across a wide range of real-world datasets show that our method enhances performance in almost all cases.



page 1

page 2

page 3

page 4


Comprehensive Analysis of Time Series Forecasting Using Neural Networks

Time series forecasting has gained lots of attention recently; this is b...

Randomized Neural Networks for Forecasting Time Series with Multiple Seasonality

This work contributes to the development of neural forecasting models wi...

Improving the Accuracy of Global Forecasting Models using Time Series Data Augmentation

Forecasting models that are trained across sets of many time series, kno...

Supporting Optimal Phase Space Reconstructions Using Neural Network Architecture for Time Series Modeling

The reconstruction of phase spaces is an essential step to analyze time ...

Cyclocopula Technique to Study the Relationship Between Two Cyclostationary Time Series with Fractional Brownian Motion Errors

Detection of the relationship between two time series is so important in...

Interpretable Conservation Law Estimation by Deriving the Symmetries of Dynamics from Trained Deep Neural Networks

As deep neural networks (DNN) have the ability to model the distribution...

Personalized Online Machine Learning

In this work, we introduce the Personalized Online Super Learner (POSL) ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.