On the Consistency of Optimal Bayesian Feature Selection in the Presence of Correlations

02/01/2020
by   Ali Foroughi pour, et al.
0

Optimal Bayesian feature selection (OBFS) is a multivariate supervised screening method designed from the ground up for biomarker discovery. In this work, we prove that Gaussian OBFS is strongly consistent under mild conditions, and provide rates of convergence for key posteriors in the framework. These results are of enormous importance, since they identify precisely what features are selected by OBFS asymptotically, characterize the relative rates of convergence for posteriors on different types of features, provide conditions that guarantee convergence, justify the use of OBFS when its internal assumptions are invalid, and set the stage for understanding the asymptotic behavior of other algorithms based on the OBFS framework.

READ FULL TEXT
research
09/09/2019

Theory of Optimal Bayesian Feature Filtering

Optimal Bayesian feature filtering (OBF) is a supervised screening metho...
research
11/05/2021

Automated Supervised Feature Selection for Differentiated Patterns of Care

An automated feature selection pipeline was developed using several stat...
research
11/03/2014

Bayesian feature selection with strongly-regularizing priors maps to the Ising Model

Identifying small subsets of features that are relevant for prediction a...
research
02/24/2015

On the consistency theory of high dimensional variable screening

Variable screening is a fast dimension reduction technique for assisting...
research
10/08/2019

Controlling Costs: Feature Selection on a Budget

The traditional framework for feature selection treats all features as c...
research
07/31/2017

Consistent Nonparametric Different-Feature Selection via the Sparsest k-Subgraph Problem

Two-sample feature selection is the problem of finding features that des...
research
03/09/2017

Sample Efficient Feature Selection for Factored MDPs

In reinforcement learning, the state of the real world is often represen...

Please sign up or login with your details

Forgot password? Click here to reset