Uncertainty Modelling in Deep Networks: Forecasting Short and Noisy Series

07/24/2018
by   Axel Brando, et al.
0

Deep Learning is a consolidated, state-of-the-art Machine Learning tool to fit a function when provided with large data sets of examples. However, in regression tasks, the straightforward application of Deep Learning models provides a point estimate of the target. In addition, the model does not take into account the uncertainty of a prediction. This represents a great limitation for tasks where communicating an erroneous prediction carries a risk. In this paper we tackle a real-world problem of forecasting impending financial expenses and incomings of customers, while displaying predictable monetary amounts on a mobile app. In this context, we investigate if we would obtain an advantage by applying Deep Learning models with a Heteroscedastic model of the variance of a network's output. Experimentally, we achieve a higher accuracy than non-trivial baselines. More importantly, we introduce a mechanism to discard low-confidence predictions, which means that they will not be visible to users. This should help enhance the user experience of our product.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/06/2020

Dropout Strikes Back: Improved Uncertainty Estimation via Diversity Sampled Implicit Ensembles

Modern machine learning models usually do not extrapolate well, i.e., th...
research
06/24/2015

Learning Representations from Deep Networks Using Mode Synthesizers

Deep learning Networks play a crucial role in the evolution of a vast nu...
research
10/06/2019

Using Deep Learning and Machine Learning to Detect Epileptic Seizure with Electroencephalography (EEG) Data

The prediction of epileptic seizure has always been extremely challengin...
research
01/06/2021

Do We Really Need Deep Learning Models for Time Series Forecasting?

Time series forecasting is a crucial task in machine learning, as it has...
research
03/31/2021

Forecasting open-high-low-close data contained in candlestick chart

Forecasting the (open-high-low-close)OHLC data contained in candlestick ...
research
10/24/2022

Are Deep Sequence Classifiers Good at Non-Trivial Generalization?

Recent advances in deep learning models for sequence classification have...
research
01/05/2022

NumHTML: Numeric-Oriented Hierarchical Transformer Model for Multi-task Financial Forecasting

Financial forecasting has been an important and active area of machine l...

Please sign up or login with your details

Forgot password? Click here to reset