An error bound for Lasso and Group Lasso in high dimensions

12/21/2019
by   Antoine Dedieu, et al.
0

We leverage recent advances in high-dimensional statistics to derive new L2 estimation upper bounds for Lasso and Group Lasso in high-dimensions. For Lasso, our bounds scale as (k^*/n) log(p/k^*)—n× p is the size of the design matrix and k^* the dimension of the ground truth β^*—and match the optimal minimax rate. For Group Lasso, our bounds scale as (s^*/n) log( G / s^* ) + m^* / n—G is the total number of groups and m^* the number of coefficients in the s^* groups which contain β^*—and improve over existing results. We additionally show that when the signal is strongly group-sparse, Group Lasso is superior to Lasso.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/06/2013

The Group Lasso for Design of Experiments

We introduce an application of the group lasso to design of exper- iment...
research
08/29/2017

Improved Support Recovery Guarantees for the Group Lasso With Applications to Structural Health Monitoring

This paper considers the problem of estimating an unknown high dimension...
research
10/16/2010

Exact block-wise optimization in group lasso and sparse group lasso for linear regression

The group lasso is a penalized regression method, used in regression pro...
research
09/14/2012

Signal Recovery in Unions of Subspaces with Applications to Compressive Imaging

In applications ranging from communications to genetics, signals can be ...
research
12/05/2015

Hierarchical Sparse Modeling: A Choice of Two Group Lasso Formulations

Demanding sparsity in estimated models has become a routine practice in ...
research
12/29/2015

Error Bounds for Compressed Sensing Algorithms With Group Sparsity: A Unified Approach

In compressed sensing, in order to recover a sparse or nearly sparse vec...
research
11/08/2020

Sparse Feature Selection Makes Batch Reinforcement Learning More Sample Efficient

This paper provides a statistical analysis of high-dimensional batch Rei...

Please sign up or login with your details

Forgot password? Click here to reset