A Screening Strategy for Structured Optimization Involving Nonconvex ℓ_q,p Regularization

08/02/2022
by   Tiange Li, et al.
2

In this paper, we develop a simple yet effective screening rule strategy to improve the computational efficiency in solving structured optimization involving nonconvex ℓ_q,p regularization. Based on an iteratively reweighted ℓ_1 (IRL1) framework, the proposed screening rule works like a preprocessing module that potentially removes the inactive groups before starting the subproblem solver, thereby reducing the computational time in total. This is mainly achieved by heuristically exploiting the dual subproblem information during each iteration.Moreover, we prove that our screening rule can remove all inactive variables in a finite number of iterations of the IRL1 method. Numerical experiments illustrate the efficiency of our screening rule strategy compared with several state-of-the-art algorithms.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/02/2021

Screening for a Reweighted Penalized Conditional Gradient Method

The conditional gradient method (CGM) is widely used in large-scale spar...
research
02/16/2019

Screening Rules for Lasso with Non-Convex Sparse Regularizers

Leveraging on the convexity of the Lasso problem , screening rules help ...
research
04/19/2020

Safe Screening Rules for ℓ_0-Regression

We give safe screening rules to eliminate variables from regression with...
research
05/07/2020

The Strong Screening Rule for SLOPE

Extracting relevant features from data sets where the number of observat...
research
12/17/2020

l1-norm quantile regression screening rule via the dual circumscribed sphere

l1-norm quantile regression is a common choice if there exists outlier o...
research
12/12/2014

Dynamic Screening: Accelerating First-Order Algorithms for the Lasso and Group-Lasso

Recent computational strategies based on screening tests have been propo...
research
01/27/2020

On Newton Screening

Screening and working set techniques are important approaches to reducin...

Please sign up or login with your details

Forgot password? Click here to reset