Convergence of an Asynchronous Block-Coordinate Forward-Backward Algorithm for Convex Composite Optimization

01/14/2022
by   Cheik Traoré, et al.
0

In this paper, we study the convergence properties of a randomized block-coordinate descent algorithm for the minimization of a composite convex objective function, where the block-coordinates are updated asynchronously and randomly according to an arbitrary probability distribution. We prove that the iterates generated by the algorithm form a stochastic quasi-Fejér sequence and thus converge almost surely to a minimizer of the objective function. Moreover, we prove a general sublinear rate of convergence in expectation for the function values and a linear rate of convergence in expectation under an error bound condition of Tseng type.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/25/2013

A Randomized Nonmonotone Block Proximal Gradient Method for a Class of Structured Nonlinear Programming

We propose a randomized nonmonotone block proximal gradient (RNBPG) meth...
research
10/22/2020

Model identification and local linear convergence of coordinate descent

For composite nonsmooth optimization problems, Forward-Backward algorith...
research
05/19/2016

Randomized Primal-Dual Proximal Block Coordinate Updates

In this paper we propose a randomized primal-dual proximal block coordin...
research
01/29/2019

Stochastic Conditional Gradient Method for Composite Convex Minimization

In this paper, we propose the first practical algorithm to minimize stoc...
research
06/13/2013

A Convergence Theorem for the Graph Shift-type Algorithms

Graph Shift (GS) algorithms are recently focused as a promising approach...
research
01/05/2022

Convergence and Complexity of Stochastic Block Majorization-Minimization

Stochastic majorization-minimization (SMM) is an online extension of the...
research
02/04/2019

Bootstrapped Coordinate Search for Multidimensional Scaling

In this work, a unified framework for gradient-free Multidimensional Sca...

Please sign up or login with your details

Forgot password? Click here to reset