Model Compression for Dynamic Forecast Combination

by   Vítor Cerqueira, et al.

The predictive advantage of combining several different predictive models is widely accepted. Particularly in time series forecasting problems, this combination is often dynamic to cope with potential non-stationary sources of variation present in the data. Despite their superior predictive performance, ensemble methods entail two main limitations: high computational costs and lack of transparency. These issues often preclude the deployment of such approaches, in favour of simpler yet more efficient and reliable ones. In this paper, we leverage the idea of model compression to address this problem in time series forecasting tasks. Model compression approaches have been mostly unexplored for forecasting. Their application in time series is challenging due to the evolving nature of the data. Further, while the literature focuses on neural networks, we apply model compression to distinct types of methods. In an extensive set of experiments, we show that compressing dynamic forecasting ensembles into an individual model leads to a comparable predictive performance and a drastic reduction in computational costs. Further, the compressed individual model with best average rank is a rule-based regression model. Thus, model compression also leads to benefits in terms of model interpretability. The experiments carried in this paper are fully reproducible.


page 18

page 19

page 21

page 23


Multi-output Ensembles for Multi-step Forecasting

This paper studies the application of ensembles composed of multi-output...

Boosted Ensemble Learning based on Randomized NNs for Time Series Forecasting

Time series forecasting is a challenging problem particularly when a tim...

Evaluating time series forecasting models: An empirical study on performance estimation methods

Performance estimation aims at estimating the loss that a predictive mod...

Differential Convolutional Fuzzy Time Series Forecasting

Fuzzy time series forecasting (FTSF) is a typical forecasting method wit...

Efficient Optimization of Echo State Networks for Time Series Datasets

Echo State Networks (ESNs) are recurrent neural networks that only train...

Time series clustering based on prediction accuracy of global forecasting models

In this paper, a novel method to perform model-based clustering of time ...

Empirical Quantitative Analysis of COVID-19 Forecasting Models

COVID-19 has been a public health emergency of international concern sin...

Please sign up or login with your details

Forgot password? Click here to reset