Nonparametric Conditional Density Estimation In A Deep Learning Framework For Short-Term Forecasting

08/17/2020
by   David B. Huberman, et al.
0

Short-term forecasting is an important tool in understanding environmental processes. In this paper, we incorporate machine learning algorithms into a conditional distribution estimator for the purposes of forecasting tropical cyclone intensity. Many machine learning techniques give a single-point prediction of the conditional distribution of the target variable, which does not give a full accounting of the prediction variability. Conditional distribution estimation can provide extra insight on predicted response behavior, which could influence decision-making and policy. We propose a technique that simultaneously estimates the entire conditional distribution and flexibly allows for machine learning techniques to be incorporated. A smooth model is fit over both the target variable and covariates, and a logistic transformation is applied on the model output layer to produce an expression of the conditional density function. We provide two examples of machine learning models that can be used, polynomial regression and deep learning models. To achieve computational efficiency we propose a case-control sampling approximation to the conditional distribution. A simulation study for four different data distributions highlights the effectiveness of our method compared to other machine learning-based conditional distribution estimation techniques. We then demonstrate the utility of our approach for forecasting purposes using tropical cyclone data from the Atlantic Seaboard. This paper gives a proof of concept for the promise of our method, further computational developments can fully unlock its insights in more complex forecasting and other applications.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/14/2019

Deep Distribution Regression

Due to their flexibility and predictive performance, machine-learning ba...
research
10/21/2020

Conditional Density Estimation via Weighted Logistic Regressions

Compared to the conditional mean as a simple point estimator, the condit...
research
09/15/2020

Demand Forecasting of individual Probability Density Functions with Machine Learning

Demand forecasting is a central component for many aspects of supply cha...
research
03/28/2021

KNN, An Underestimated Model for Regional Rainfall Forecasting

Regional rainfall forecasting is an important issue in hydrology and met...
research
12/09/2019

Conditional Kernel Density Estimation Considering Autocorrelation for Renewable Energy Probabilistic Modeling

Renewable energy is essential for energy security and global warming mit...
research
01/04/2020

CatBoostLSS – An extension of CatBoost to probabilistic forecasting

We propose a new framework of CatBoost that predicts the entire conditio...
research
07/06/2019

XGBoostLSS -- An extension of XGBoost to probabilistic forecasting

We propose a new framework of XGBoost that predicts the entire condition...

Please sign up or login with your details

Forgot password? Click here to reset