Generalized Conditional Gradient for Sparse Estimation

10/17/2014
by   Yaoliang Yu, et al.
0

Structured sparsity is an important modeling tool that expands the applicability of convex formulations for data analysis, however it also creates significant challenges for efficient algorithm design. In this paper we investigate the generalized conditional gradient (GCG) algorithm for solving structured sparse optimization problems---demonstrating that, with some enhancements, it can provide a more efficient alternative to current state of the art approaches. After providing a comprehensive overview of the convergence properties of GCG, we develop efficient methods for evaluating polar operators, a subroutine that is required in each GCG iteration. In particular, we show how the polar operator can be efficiently evaluated in two important scenarios: dictionary learning and structured sparse estimation. A further improvement is achieved by interleaving GCG with fixed-rank local subspace optimization. A series of experiments on matrix completion, multi-class classification, multi-view dictionary learning and overlapping group lasso shows that the proposed method can significantly reduce the training cost of current alternatives.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/01/2012

Collaborative Filtering via Group-Structured Dictionary Learning

Structured sparse coding and the related structured dictionary learning ...
research
05/25/2016

Simultaneous Sparse Dictionary Learning and Pruning

Dictionary learning is a cutting-edge area in imaging processing, that h...
research
05/31/2018

Analysis of Fast Structured Dictionary Learning

Sparsity-based models and techniques have been exploited in many signal ...
research
11/01/2018

Efficient Multi-Domain Dictionary Learning with GANs

In this paper, we propose the multi-domain dictionary learning (MDDL) to...
research
02/01/2018

Analysis of Fast Alternating Minimization for Structured Dictionary Learning

Methods exploiting sparsity have been popular in imaging and signal proc...
research
09/08/2009

Structured Sparse Principal Component Analysis

We present an extension of sparse PCA, or sparse dictionary learning, wh...
research
11/06/2018

Frank-Wolfe Algorithm for Exemplar Selection

In this paper, we consider the problem of selecting representatives from...

Please sign up or login with your details

Forgot password? Click here to reset