High-dimensional outlier detection and variable selection via adaptive weighted mean regression

06/24/2023
by   Jiaqi Li, et al.
0

This paper proposes an adaptive penalized weighted mean regression for outlier detection of high-dimensional data. In comparison to existing approaches based on the mean shift model, the proposed estimators demonstrate robustness against outliers present in both response variables and/or covariates. By utilizing the adaptive Huber loss function, the proposed method is effective in high-dimensional linear models characterized by heavy-tailed and heteroscedastic error distributions. The proposed framework enables simultaneous and collaborative estimation of regression parameters and outlier detection. Under regularity conditions, outlier detection consistency and oracle inequalities of robust estimates in high-dimensional settings are established. Additionally, theoretical robustness properties, such as the breakdown point and a smoothed limiting influence function, are ascertained. Extensive simulation studies and a breast cancer survival data are used to evaluate the numerical performance of the proposed method, demonstrating comparable or superior variable selection and outlier detection capabilities.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/12/2020

Robust approach for variable selection with high dimensional Logitudinal data analysis

This paper proposes a new robust smooth-threshold estimating equation to...
research
09/27/2022

Wilcoxon-type Multivariate Cluster Elastic Net

We propose a method for high dimensional multivariate regression that is...
research
06/30/2021

Adaptively Robust Geographically Weighted Regression

We develop a new robust geographically weighted regression method in the...
research
03/19/2021

Robust penalized empirical likelihood in high dimensional longitudinal data analysis

As an effective nonparametric method, empirical likelihood (EL) is appea...
research
07/12/2020

Simultaneous Feature Selection and Outlier Detection with Optimality Guarantees

Sparse estimation methods capable of tolerating outliers have been broad...
research
12/15/2021

Gaining Outlier Resistance with Progressive Quantiles: Fast Algorithms and Theoretical Studies

Outliers widely occur in big-data applications and may severely affect s...
research
07/07/2021

Robust Variable Selection and Estimation Via Adaptive Elastic Net S-Estimators for Linear Regression

Heavy-tailed error distributions and predictors with anomalous values ar...

Please sign up or login with your details

Forgot password? Click here to reset