Context-dependent feature analysis with random forests

05/12/2016
by   Antonio Sutera, et al.
0

In many cases, feature selection is often more complicated than identifying a single subset of input variables that would together explain the output. There may be interactions that depend on contextual information, i.e., variables that reveal to be relevant only in some specific circumstances. In this setting, the contribution of this paper is to extend the random forest variable importances framework in order (i) to identify variables whose relevance is context-dependent and (ii) to characterize as precisely as possible the effect of contextual information on these variables. The usage and the relevance of our framework for highlighting context-dependent variables is illustrated on both artificial and real datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/23/2023

Cost-aware learning of relevant contextual variables within Bayesian optimization

Contextual Bayesian Optimization (CBO) is a powerful framework for optim...
research
09/04/2017

Random Subspace with Trees for Feature Selection Under Memory Constraints

Dealing with datasets of very high dimension is a major challenge in mac...
research
11/03/2021

From global to local MDI variable importances for random forests and when they are Shapley values

Random forests have been widely used for their ability to provide so-cal...
research
04/01/2020

Sequential Feature Classification in the Context of Redundancies

The problem of all-relevant feature selection is concerned with finding ...
research
06/24/2016

Regression Trees and Random forest based feature selection for malaria risk exposure prediction

This paper deals with prediction of anopheles number, the main vector of...
research
05/16/2017

All-relevant feature selection using multidimensional filters with exhaustive search

This paper describes a method for identification of the informative vari...
research
12/10/2019

Feature Relevance Determination for Ordinal Regression in the Context of Feature Redundancies and Privileged Information

Advances in machine learning technologies have led to increasingly power...

Please sign up or login with your details

Forgot password? Click here to reset