A Distance-Based Branch and Bound Feature Selection Algorithm

10/19/2012
by   Ari Frank, et al.
0

There is no known efficient method for selecting k Gaussian features from n which achieve the lowest Bayesian classification error. We show an example of how greedy algorithms faced with this task are led to give results that are not optimal. This motivates us to propose a more robust approach. We present a Branch and Bound algorithm for finding a subset of k independent Gaussian features which minimizes the naive Bayesian classification error. Our algorithm uses additive monotonic distance measures to produce bounds for the Bayesian classification error in order to exclude many feature subsets from evaluation, while still returning an optimal solution. We test our method on synthetic data as well as data obtained from gene expression profiling.

READ FULL TEXT

page 1

page 5

research
09/09/2019

Theory of Optimal Bayesian Feature Filtering

Optimal Bayesian feature filtering (OBF) is a supervised screening metho...
research
05/29/2018

On Robust Trimming of Bayesian Network Classifiers

This paper considers the problem of removing costly features from a Baye...
research
02/05/2019

Robust Regression via Online Feature Selection under Adversarial Data Corruption

The presence of data corruption in user-generated streaming data, such a...
research
09/18/2016

Probabilistic Feature Selection and Classification Vector Machine

Sparse Bayesian learning is one of the state-of- the-art machine learnin...
research
04/12/2018

Regularized Greedy Column Subset Selection

The Column Subset Selection Problem provides a natural framework for uns...
research
02/07/2013

Feature Selection for Microarray Gene Expression Data using Simulated Annealing guided by the Multivariate Joint Entropy

In this work a new way to calculate the multivariate joint entropy is pr...
research
09/21/2021

Classification with Nearest Disjoint Centroids

In this paper, we develop a new classification method based on nearest c...

Please sign up or login with your details

Forgot password? Click here to reset