On the conditions used to prove oracle results for the Lasso

10/05/2009
by   Sara A. van de Geer, et al.
0

Oracle inequalities and variable selection properties for the Lasso in linear models have been established under a variety of different assumptions on the design matrix. We show in this paper how the different conditions and concepts relate to each other. The restricted eigenvalue condition (Bickel et al., 2009) or the slightly weaker compatibility condition (van de Geer, 2007) are sufficient for oracle results. We argue that both these conditions allow for a fairly general class of design matrices. Hence, optimality of the Lasso for prediction and estimation holds for more general situations than what it appears from coherence (Bunea et al, 2007b,c) or restricted isometry (Candes and Tao, 2005) assumptions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/23/2021

A note on sharp oracle bounds for Slope and Lasso

In this paper, we study the sharp oracle bounds for Slope and Lasso and ...
research
03/29/2019

Variable selection and estimation in multivariate functional linear regression via the lasso

In more and more applications, a quantity of interest may depend on seve...
research
06/28/2018

Signal Recovery under Cumulative Coherence

This paper considers signal recovery in the framework of cumulative cohe...
research
10/12/2010

Optimal designs for Lasso and Dantzig selector using Expander Codes

We investigate the high-dimensional regression problem using adjacency m...
research
08/18/2023

Sharp minimax optimality of LASSO and SLOPE under double sparsity assumption

This paper introduces a rigorous approach to establish the sharp minimax...
research
10/17/2012

Mixture model for designs in high dimensional regression and the LASSO

The LASSO is a recent technique for variable selection in the regression...
research
06/29/2020

Recovery of Sparse Signals from a Mixture of Linear Samples

Mixture of linear regressions is a popular learning theoretic model that...

Please sign up or login with your details

Forgot password? Click here to reset