Isotonic Distributional Regression

09/09/2019
by   Alexander Henzi, et al.
0

Isotonic distributional regression (IDR) is a powerful nonparametric technique for the estimation of conditional distributions under order restrictions. In a nutshell, IDR learns conditional distributions that are calibrated, and simultaneously optimal relative to comprehensive classes of relevant loss functions, subject to isotonicity constraints in terms of a partial order on the covariate space. Nonparametric isotonic quantile regression and probabilistic classifiers for binary events emerge as special cases. For prediction, we propose an interpolation method that generalizes extant specifications under the pool adjacent violators algorithm. We recommend the use of IDR as a generic benchmark technique in probabilistic forecast problems, as it does not involve any parameter tuning nor implementation choices, except for the selection of a partial order on the covariate space. The method can be combined with subsample aggregation, with the benefits of smoother regression functions and computational efficiency under large training sets. In a case study on raw and postprocessed quantitative precipitation forecasts from a leading numerical weather prediction system, IDR is competitive with state of the art techniques.

READ FULL TEXT
research
03/29/2020

Testing Conditional Independence via Quantile Regression Based Partial Copulas

The partial copula provides a method for describing the dependence betwe...
research
09/22/2012

An efficient model-free estimation of multiclass conditional probability

Conventional multiclass conditional probability estimation methods, such...
research
05/06/2020

A framework for probabilistic weather forecast post-processing across models and lead times using machine learning

Forecasting the weather is an increasingly data intensive exercise. Nume...
research
12/16/2022

Easy Uncertainty Quantification (EasyUQ): Generating predictive distributions from single-valued model output

How can we quantify uncertainty if our favorite computational tool - be ...
research
12/14/2017

Nonparametric Adaptive CUSUM Chart for Detecting Arbitrary Distributional Changes

Nonparametric control charts that can detect arbitrary distributional ch...
research
06/09/2020

Accelerating the pool-adjacent-violators algorithm for isotonic distributional regression

In this note we describe in detail how to apply the pool-adjacent-violat...
research
06/25/2018

Does data interpolation contradict statistical optimality?

We show that learning methods interpolating the training data can achiev...

Please sign up or login with your details

Forgot password? Click here to reset