A Random Forest Approach for Modeling Bounded Outcomes

01/18/2019
by   Leonie Weinhold, et al.
0

Random forests have become an established tool for classification and regression, in particular in high-dimensional settings and in the presence of complex predictor-response relationships. For bounded outcome variables restricted to the unit interval, however, classical random forest approaches may severely suffer as they do not account for the heteroscedasticity in the data. A random forest approach is proposed for relating beta distributed outcomes to explanatory variables. The approach explicitly makes use of the likelihood function of the beta distribution for the selection of splits during the tree-building procedure. In each iteration of the tree-building algorithm one chooses the combination of explanatory variable and splitting rule that maximizes the log-likelihood function of the beta distribution with the parameter estimates derived from the nodes of the currently built tree. Several simulation studies demonstrate the properties of the method and compare its performance to classical random forest approaches as well as to parametric regression models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/30/2022

Extremal Random Forests

Classical methods for quantile regression fail in cases where the quanti...
research
02/12/2022

The Impact of Using Regression Models to Build Defect Classifiers

It is common practice to discretize continuous defect counts into defect...
research
04/29/2020

Asymptotic Properties of High-Dimensional Random Forests

As a flexible nonparametric learning tool, random forest has been widely...
research
05/11/2020

Interpretable random forest models through forward variable selection

Random forest is a popular prediction approach for handling high dimensi...
research
04/05/2023

Opening the random forest black box by the analysis of the mutual impact of features

Random forest is a popular machine learning approach for the analysis of...
research
06/29/2023

Medoid splits for efficient random forests in metric spaces

This paper revisits an adaptation of the random forest algorithm for Fré...
research
12/29/2020

Random Planted Forest: a directly interpretable tree ensemble

We introduce a novel interpretable and tree-based algorithm for predicti...

Please sign up or login with your details

Forgot password? Click here to reset