Random Coordinate Descent Methods for Minimizing Decomposable Submodular Functions

02/09/2015
by   Alina Ene, et al.
0

Submodular function minimization is a fundamental optimization problem that arises in several applications in machine learning and computer vision. The problem is known to be solvable in polynomial time, but general purpose algorithms have high running times and are unsuitable for large-scale problems. Recent work have used convex optimization techniques to obtain very practical algorithms for minimizing functions that are sums of "simple" functions. In this paper, we use random coordinate descent methods to obtain algorithms with faster linear convergence rates and cheaper iteration costs. Compared to alternating projection methods, our algorithms do not rely on full-dimensional vector operations and they converge in significantly fewer iterations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/29/2019

Minimizing approximately submodular functions

The problem of minimizing a submodular function is well studied; several...
research
03/04/2020

Safeguarded Learned Convex Optimization

Many applications require repeatedly solving a certain type of optimizat...
research
06/26/2018

Quadratic Decomposable Submodular Function Minimization

We introduce a new convex optimization problem, termed quadratic decompo...
research
02/26/2019

Quadratic Decomposable Submodular Function Minimization: Theory and Practice

We introduce a new convex optimization problem, termed quadratic decompo...
research
10/15/2014

Complexity Issues and Randomization Strategies in Frank-Wolfe Algorithms for Machine Learning

Frank-Wolfe algorithms for convex minimization have recently gained cons...
research
09/23/2013

Smooth minimization of nonsmooth functions with parallel coordinate descent methods

We study the performance of a family of randomized parallel coordinate d...
research
12/23/2009

Fast Alternating Linearization Methods for Minimizing the Sum of Two Convex Functions

We present in this paper first-order alternating linearization algorithm...

Please sign up or login with your details

Forgot password? Click here to reset