Screening Rules for Convex Problems

09/23/2016
by   Anant Raj, et al.
0

We propose a new framework for deriving screening rules for convex optimization problems. Our approach covers a large class of constrained and penalized optimization formulations, and works in two steps. First, given any approximate point, the structure of the objective function and the duality gap is used to gather information on the optimal solution. In the second step, this information is used to produce screening rules, i.e. safely identifying unimportant weight variables of the optimal solution. Our general framework leads to a large variety of useful existing as well as new screening rules for many applications. For example, we provide new screening rules for general simplex and L_1-constrained problems, Elastic Net, squared-loss Support Vector Machines, minimum enclosing ball, as well as structured norm regularized problems, such as group lasso.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/19/2020

Safe Screening Rules for ℓ_0-Regression

We give safe screening rules to eliminate variables from regression with...
research
02/09/2020

Learning High Order Feature Interactions with Fine Control Kernels

We provide a methodology for learning sparse statistical models that use...
research
06/11/2020

Safe Screening Rules for Generalized Double Sparsity Learning

In a high-dimensional setting, sparse model has shown its power in compu...
research
12/11/2015

A Unified Approach to Error Bounds for Structured Convex Optimization Problems

Error bounds, which refer to inequalities that bound the distance of vec...
research
10/25/2014

Screening Rules for Overlapping Group Lasso

Recently, to solve large-scale lasso and group lasso problems, screening...
research
01/09/2022

Inverse optimization problems with multiple weight functions

We introduce a new class of inverse optimization problems in which an in...
research
03/07/2017

Faster Coordinate Descent via Adaptive Importance Sampling

Coordinate descent methods employ random partial updates of decision var...

Please sign up or login with your details

Forgot password? Click here to reset