The Geometry of Uniqueness and Model Selection of Penalized Estimators including SLOPE, LASSO, and Basis Pursuit

04/20/2020
by   Ulrike Schneider, et al.
0

We provide a necessary and sufficient condition for the uniqueness of penalized least-squares estimators with a penalty term consisting a norm whose unit ball is given by a polytope. The condition is given by a geometric criterion involving how the row span of the design matrix intersects the faces of the dual norm unit cube. This criterion also provides information about the model selection properties of the corresponding estimation method. Our analyses cover LASSO, the related method of basis pursuit, as well as the SLOPE estimator.

READ FULL TEXT
research
07/19/2023

Pattern Recovery in Penalized and Thresholded Estimation and its Geometry

We consider the framework of penalized estimation where the penalty term...
research
04/19/2011

A sufficient condition on monotonic increase of the number of nonzero entry in the optimizer of L1 norm penalized least-square problem

The ℓ-1 norm based optimization is widely used in signal processing, esp...
research
11/05/2007

On the Distribution of Penalized Maximum Likelihood Estimators: The LASSO, SCAD, and Thresholding

We study the distributions of the LASSO, SCAD, and thresholding estimato...
research
07/01/2019

The Constrained L_p-L_q Basis Pursuit Denoising Problem

In this paper, we consider the constrained L_p-L_q basis pursuit denoisi...
research
07/16/2018

Group Invariance and Computational Sufficiency

Statistical sufficiency formalizes the notion of data reduction. In the ...
research
12/13/2018

On the sign recovery given by the thresholded LASSO and thresholded Basis Pursuit

We consider the regression model, when the number of observations is sma...
research
09/08/2018

Computational Sufficiency, Reflection Groups, and Generalized Lasso Penalties

We study estimators with generalized lasso penalties within the computat...

Please sign up or login with your details

Forgot password? Click here to reset