The Symmetry of a Simple Optimization Problem in Lasso Screening

08/21/2016
by   Yun Wang, et al.
0

Recently dictionary screening has been proposed as an effective way to improve the computational efficiency of solving the lasso problem, which is one of the most commonly used method for learning sparse representations. To address today's ever increasing large dataset, effective screening relies on a tight region bound on the solution to the dual lasso. Typical region bounds are in the form of an intersection of a sphere and multiple half spaces. One way to tighten the region bound is using more half spaces, which however, adds to the overhead of solving the high dimensional optimization problem in lasso screening. This paper reveals the interesting property that the optimization problem only depends on the projection of features onto the subspace spanned by the normals of the half spaces. This property converts an optimization problem in high dimension to much lower dimension, and thus sheds light on reducing the computation overhead of lasso screening based on tighter region bounds.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/02/2022

Beyond GAP screening for Lasso by exploiting new dual cutting half-spaces with supplementary material

In this paper, we propose a novel safe screening test for Lasso. Our pro...
research
11/16/2012

Lasso Screening Rules via Dual Polytope Projection

Lasso is a widely used regression technique to find sparse representatio...
research
05/19/2014

Screening Tests for Lasso Problems

This paper is a survey of dictionary screening for the lasso problem. Th...
research
10/25/2014

Screening Rules for Overlapping Group Lasso

Recently, to solve large-scale lasso and group lasso problems, screening...
research
12/12/2014

Dynamic Screening: Accelerating First-Order Algorithms for the Lasso and Group-Lasso

Recent computational strategies based on screening tests have been propo...
research
01/27/2020

On Newton Screening

Screening and working set techniques are important approaches to reducin...
research
08/21/2016

Feedback-Controlled Sequential Lasso Screening

One way to solve lasso problems when the dictionary does not fit into av...

Please sign up or login with your details

Forgot password? Click here to reset