Pattern recovery by SLOPE

03/22/2022
by   Malgorzata Bogdan, et al.
0

LASSO and SLOPE are two popular methods for dimensionality reduction in the high-dimensional regression. LASSO can eliminate redundant predictors by setting the corresponding regression coefficients to zero, while SLOPE can additionally identify clusters of variables with the same absolute values of regression coefficients. It is well known that LASSO Irrepresentability Condition is sufficient and necessary for the proper estimation of the sign of sufficiently large regression coefficients. In this article we formulate an analogous Irrepresentability Condition for SLOPE, which is sufficient and necessary for the proper identification of the SLOPE pattern, i.e. of the proper sign as well as of the proper ranking of the absolute values of individual regression coefficients, while proper ranking guarantees a proper clustering. We also provide asymptotic results on the strong consistency of pattern recovery by SLOPE when the number of columns in the design matrix is fixed while the sample size diverges to infinity.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/13/2018

On the sign recovery given by the thresholded LASSO and thresholded Basis Pursuit

We consider the regression model, when the number of observations is sma...
research
02/17/2022

Pattern recovery and signal denoising by SLOPE when the design matrix is orthogonal

Sorted ℓ_1 Penalized Estimator (SLOPE) is a relatively new convex regula...
research
07/19/2023

Pattern Recovery in Penalized and Thresholded Estimation and its Geometry

We consider the framework of penalized estimation where the penalty term...
research
12/14/2022

On LASSO for High Dimensional Predictive Regression

In a high dimensional linear predictive regression where the number of p...
research
09/10/2021

Reducing bias and alleviating the influence of excess of zeros with multioutcome adaptive LAD-lasso

Zero-inflated explanatory variables are common in fields such as ecology...
research
07/30/2013

Sharp Threshold for Multivariate Multi-Response Linear Regression via Block Regularized Lasso

In this paper, we investigate a multivariate multi-response (MVMR) linea...
research
08/10/2017

When Does the First Spurious Variable Get Selected by Sequential Regression Procedures?

Applied statisticians use sequential regression procedures to produce a ...

Please sign up or login with your details

Forgot password? Click here to reset