Robust Variable Selection under Cellwise Contamination

10/24/2021
by   Peng Su, et al.
0

Cellwise outliers are widespread in data and traditional robust methods may fail when applied to datasets under such contamination. We propose a variable selection procedure, that uses a pairwise robust estimator to obtain an initial empirical covariance matrix among the response and potentially many predictors. Then we replace the primary design matrix and the response vector with their robust counterparts based on the estimated covariance matrix. Finally, we adopt the adaptive Lasso to obtain variable selection results. The proposed approach is robust to cellwise outliers in regular and high dimensional settings and empirical results show good performance in comparison with recently proposed alternative robust approaches, particularly in the challenging setting when contamination rates are high but the magnitude of outliers is moderate. Real data applications demonstrate the practical utility of the proposed method.

READ FULL TEXT

page 3

page 13

research
07/07/2021

Bounded support in linear random coefficient models: Identification and variable selection

We consider linear random coefficient regression models, where the regre...
research
12/29/2019

Robust Variable Selection Criteria for the Penalized Regression

We propose a robust variable selection procedure using a divergence base...
research
11/12/2020

Robust approach for variable selection with high dimensional Logitudinal data analysis

This paper proposes a new robust smooth-threshold estimating equation to...
research
10/12/2019

Real-time outlier detection for large datasets by RT-DetMCD

Modern industrial machines can generate gigabytes of data in seconds, fr...
research
07/29/2020

Robust variable selection for model-based learning in presence of adulteration

The problem of identifying the most discriminating features when perform...
research
12/28/2019

Flagging and handling cellwise outliers by robust estimation of a covariance matrix

We propose a method for detecting cellwise outliers. Given a robust cova...
research
10/28/2019

Power analysis of knockoff filters for correlated designs

The knockoff filter introduced by Barber and Candès 2016 is an elegant f...

Please sign up or login with your details

Forgot password? Click here to reset