Selective Cascade of Residual ExtraTrees

09/29/2020
by   Qimin Liu, et al.
0

We propose a novel tree-based ensemble method named Selective Cascade of Residual ExtraTrees (SCORE). SCORE draws inspiration from representation learning, incorporates regularized regression with variable selection features, and utilizes boosting to improve prediction and reduce generalization errors. We also develop a variable importance measure to increase the explainability of SCORE. Our computer experiments show that SCORE provides comparable or superior performance in prediction against ExtraTrees, random forest, gradient boosting machine, and neural networks; and the proposed variable importance measure for SCORE is comparable to studied benchmark methods. Finally, the predictive performance of SCORE remains stable across hyper-parameter values, suggesting potential robustness to hyperparameter specification.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/25/2015

Prediction Error Reduction Function as a Variable Importance Score

This paper introduces and develops a novel variable importance score fun...
research
03/17/2022

GAM(L)A: An econometric model for interpretable Machine Learning

Despite their high predictive performance, random forest and gradient bo...
research
02/06/2020

Robust Boosting for Regression Problems

The gradient boosting algorithm constructs a regression estimator using ...
research
04/29/2018

Dense Adaptive Cascade Forest: A Densely Connected Deep Ensemble for Classification Problems

Recent research has shown that deep ensemble for forest can achieve a hu...
research
11/03/2019

Variable Grouping Based Bayesian Additive Regression Tree

Using ensemble methods for regression has been a large success in obtain...
research
05/11/2020

Interpretable random forest models through forward variable selection

Random forest is a popular prediction approach for handling high dimensi...
research
12/23/2022

Neural Networks beyond explainability: Selective inference for sequence motifs

Over the past decade, neural networks have been successful at making pre...

Please sign up or login with your details

Forgot password? Click here to reset