Safe rules for the identification of zeros in the solutions of the SLOPE problem

10/22/2021
by   Clément Elvira, et al.
0

In this paper we propose a methodology to accelerate the resolution of the so-called “Sorted L-One Penalized Estimation” (SLOPE) problem. Our method leverages the concept of “safe screening”, well-studied in the literature for group-separable sparsity-inducing norms, and aims at identifying the zeros in the solution of SLOPE. More specifically, we introduce a family of n! safe screening rules for this problem, where n is the dimension of the primal variable, and propose a tractable procedure to verify if one of these tests is passed. Our procedure has a complexity 𝒪(nlog n + LT) where T≤ n is a problem-dependent constant and L is the number of zeros identified by the tests. We assess the performance of our proposed method on a numerical benchmark and emphasize that it leads to significant computational savings in many setups.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/11/2020

Safe Screening Rules for Generalized Double Sparsity Learning

In a high-dimensional setting, sparse model has shown its power in compu...
research
02/28/2023

Safe peeling for l0-regularized least-squares with supplementary material

We introduce a new methodology dubbed “safe peeling” to accelerate the r...
research
11/18/2019

Safe squeezing for antisparse coding

Spreading the information over all coefficients of a representation is a...
research
06/11/2015

GAP Safe screening rules for sparse multi-task and multi-class models

High dimensional regression benefits from sparsity promoting regularizat...
research
12/05/2019

Screening Data Points in Empirical Risk Minimization via Ellipsoidal Regions and Safe Loss Function

We design simple screening tests to automatically discard data samples i...
research
01/25/2022

How Hard is Safe Bribery?

Bribery in an election is one of the well-studied control problems in co...
research
09/06/2020

Screening Rules and its Complexity for Active Set Identification

Screening rules were recently introduced as a technique for explicitly i...

Please sign up or login with your details

Forgot password? Click here to reset