A Worrying Analysis of Probabilistic Time-series Models for Sales Forecasting

11/21/2020
by   Seungjae Jung, et al.
0

Probabilistic time-series models become popular in the forecasting field as they help to make optimal decisions under uncertainty. Despite the growing interest, a lack of thorough analysis hinders choosing what is worth applying for the desired task. In this paper, we analyze the performance of three prominent probabilistic time-series models for sales forecasting. To remove the role of random chance in architecture's performance, we make two experimental principles; 1) Large-scale dataset with various cross-validation sets. 2) A standardized training and hyperparameter selection. The experimental results show that a simple Multi-layer Perceptron and Linear Regression outperform the probabilistic models on RMSE without any feature engineering. Overall, the probabilistic models fail to achieve better performance on point estimation, such as RMSE and MAPE, than comparably simple baselines. We analyze and discuss the performances of probabilistic time-series models.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

06/08/2021

RECOWNs: Probabilistic Circuits for Trustworthy Time Series Forecasting

Time series forecasting is a relevant task that is performed in several ...
05/28/2019

Evaluating time series forecasting models: An empirical study on performance estimation methods

Performance estimation aims at estimating the loss that a predictive mod...
11/21/2019

Bayesian forecasting of multivariate time series: Scalability, structure uncertainty and decisions

I overview recent research advances in Bayesian state-space modeling of ...
09/18/2020

Explainable boosted linear regression for time series forecasting

Time series forecasting involves collecting and analyzing past observati...
07/08/2014

Meteorological time series forecasting with pruned multi-layer perceptron and 2-stage Levenberg-Marquardt method

A Multi-Layer Perceptron (MLP) defines a family of artificial neural net...
08/08/2013

Time series modeling with pruned multi-layer perceptron and 2-stage damped least-squares method

A Multi-Layer Perceptron (MLP) defines a family of artificial neural net...
02/24/2022

Robust Probabilistic Time Series Forecasting

Probabilistic time series forecasting has played critical role in decisi...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.