Sparse Support Vector Infinite Push

06/27/2012
by   Alain Rakotomamonjy, et al.
0

In this paper, we address the problem of embedded feature selection for ranking on top of the list problems. We pose this problem as a regularized empirical risk minimization with p-norm push loss function (p=∞) and sparsity inducing regularizers. We leverage the issues related to this challenging optimization problem by considering an alternating direction method of multipliers algorithm which is built upon proximal operators of the loss function and the regularizer. Our main technical contribution is thus to provide a numerical scheme for computing the infinite push loss function proximal operator. Experimental results on toy, DNA microarray and BCI problems show how our novel algorithm compares favorably to competitors for ranking on top while using fewer variables in the scoring function.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/13/2016

Efficient Learning with a Family of Nonconvex Regularizers by Redistributing Nonconvexity

The use of convex regularizers allows for easy optimization, though they...
research
07/02/2015

DC Proximal Newton for Non-Convex Optimization Problems

We introduce a novel algorithm for solving learning problems where both ...
research
05/09/2017

Adaptive Regularization of Some Inverse Problems in Image Analysis

We present an adaptive regularization scheme for optimizing composite en...
research
08/26/2022

Splitting Method for Support Vector Machine with Lower Semi-continuous Loss

In this paper, we study the splitting method based on alternating direct...
research
12/16/2013

Adaptive Stochastic Alternating Direction Method of Multipliers

The Alternating Direction Method of Multipliers (ADMM) has been studied ...
research
10/04/2019

Efficient Symmetric Norm Regression via Linear Sketching

We provide efficient algorithms for overconstrained linear regression pr...
research
10/14/2021

Algorithms for Sparse Support Vector Machines

Many problems in classification involve huge numbers of irrelevant featu...

Please sign up or login with your details

Forgot password? Click here to reset