HDI-Forest: Highest Density Interval Regression Forest

05/24/2019
by   Lin Zhu, et al.
0

By seeking the narrowest prediction intervals (PIs) that satisfy the specified coverage probability requirements, the recently proposed quality-based PI learning principle can extract high-quality PIs that better summarize the predictive certainty in regression tasks, and has been widely applied to solve many practical problems. Currently, the state-of-the-art quality-based PI estimation methods are based on deep neural networks or linear models. In this paper, we propose Highest Density Interval Regression Forest (HDI-Forest), a novel quality-based PI estimation method that is instead based on Random Forest. HDI-Forest does not require additional model training, and directly reuses the trees learned in a standard Random Forest model. By utilizing the special properties of Random Forest, HDI-Forest could efficiently and more directly optimize the PI quality metrics. Extensive experiments on benchmark datasets show that HDI-Forest significantly outperforms previous approaches, reducing the average PI width by over 30% while achieving the same or better coverage probability.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/14/2018

Making Sense of Random Forest Probabilities: a Kernel Perspective

A random forest is a popular tool for estimating probabilities in machin...
research
04/23/2019

Crop yield probability density forecasting via quantile random forest and Epanechnikov Kernel function

A reliable and accurate forecasting method for crop yields is very impor...
research
03/26/2023

Extrapolation to complete basis-set limit in density-functional theory by quantile random-forest models

The numerical precision of density-functional-theory (DFT) calculations ...
research
12/11/2021

Confidence intervals for the random forest generalization error

We show that underneath the training process of a random forest there li...
research
04/26/2021

Multi-Output Random Forest Regression to Emulate the Earliest Stages of Planet Formation

In the current paradigm of planet formation research, it is believed tha...
research
08/22/2022

MetaRF: Differentiable Random Forest for Reaction Yield Prediction with a Few Trails

Artificial intelligence has deeply revolutionized the field of medicinal...
research
12/14/2022

Simplification of Forest Classifiers and Regressors

We study the problem of sharing as many branching conditions of a given ...

Please sign up or login with your details

Forgot password? Click here to reset