Robust variable selection for model-based learning in presence of adulteration

07/29/2020
by   Andrea Cappozzo, et al.
0

The problem of identifying the most discriminating features when performing supervised learning has been extensively investigated. In particular, several methods for variable selection in model-based classification have been proposed. Surprisingly, the impact of outliers and wrongly labeled units on the determination of relevant predictors has received far less attention, with almost no dedicated methodologies available in the literature. In the present paper, we introduce two robust variable selection approaches: one that embeds a robust classifier within a greedy-forward selection procedure and the other based on the theory of maximum likelihood estimation and irrelevance. The former recasts the feature identification as a model selection problem, while the latter regards the relevant subset as a model parameter to be estimated. The benefits of the proposed methods, in contrast with non-robust solutions, are assessed via an experiment on synthetic data. An application to a high-dimensional classification problem of contaminated spectroscopic data concludes the paper.

READ FULL TEXT
research
11/23/2021

Trimming Stability Selection increases variable selection robustness

Contamination can severely distort an estimator unless the estimation pr...
research
04/12/2019

A robust approach to model-based classification based on trimming and constraints

In a standard classification framework a set of trustworthy learning dat...
research
10/24/2021

Robust Variable Selection under Cellwise Contamination

Cellwise outliers are widespread in data and traditional robust methods ...
research
10/15/2017

Variable selection for (realistic) stochastic blockmodels

Stochastic blockmodels provide a convenient representation of relations ...
research
11/11/2020

Robust multi-stage model-based design of optimal experiments for nonlinear estimation

We study approaches to robust model-based design of experiments in the c...
research
10/19/2016

Robust and Parallel Bayesian Model Selection

Effective and accurate model selection is an important problem in modern...

Please sign up or login with your details

Forgot password? Click here to reset