Variable Selection Using Bayesian Additive Regression Trees

12/28/2021
by   Chuji Luo, et al.
0

Variable selection is an important statistical problem. This problem becomes more challenging when the candidate predictors are of mixed type (e.g. continuous and binary) and impact the response variable in nonlinear and/or non-additive ways. In this paper, we review existing variable selection approaches for the Bayesian additive regression trees (BART) model, a nonparametric regression model, which is flexible enough to capture the interactions between predictors and nonlinear relationships with the response. An emphasis of this review is on the capability of identifying relevant predictors. We also propose two variable importance measures which can be used in a permutation-based variable selection approach, and a backward variable selection procedure for BART. We present simulations demonstrating that our approaches exhibit improved performance in terms of the ability to recover all the relevant predictors in a variety of data settings, compared to existing BART-based variable selection methods.

READ FULL TEXT
research
06/18/2018

Variable Importance Assessments and Backward Variable Selection for High-Dimensional Data

Variable selection in high-dimensional scenarios is of great interested ...
research
07/01/2023

A Transparent and Nonlinear Method for Variable Selection

Variable selection is a procedure to attain the truly important predicto...
research
01/22/2018

Predictor Variable Prioritization in Nonlinear Models: A Genetic Association Case Study

The central aim in this paper is to address variable selection questions...
research
10/19/2021

Operator-induced structural variable selection for identifying materials genes

In the emerging field of materials informatics, a fundamental task is to...
research
05/19/2020

Do Code Review Measures Explain the Incidence of Post-Release Defects?

Aim: In contrast to studies of defects found during code review, we aim ...
research
01/20/2016

Nonlinear variable selection with continuous outcome: a nonparametric incremental forward stagewise approach

We present a method of variable selection for the situation where some p...

Please sign up or login with your details

Forgot password? Click here to reset