On Parallel or Distributed Asynchronous Iterations with Unbounded Delays and Possible Out of Order Messages or Flexible Communication for Convex Optimization Problems and Machi

10/05/2022
by   Didier El Baz, et al.
0

We describe several features of parallel or distributed asynchronous iterative algorithms such as unbounded delays, possible out of order messages or flexible communication. We concentrate on the concept of macroiteration sequence which was introduced in order to study the convergence or termination of asynchronous iterations. A survey of asynchronous iterations for convex optimization problems is also presented. Finally, a new result of convergence for parallel or distributed asynchronous iterative algorithms with flexible communication for convex optimization problems and machine learning is proposed.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/09/2021

Asynchronous Iterations in Optimization: New Sequence Results and Sharper Algorithmic Guarantees

We introduce novel convergence results for asynchronous iterations which...
research
03/06/2020

Asynchronous and Parallel Distributed Pose Graph Optimization

We present Asynchronous Stochastic Parallel Pose Graph Optimization (ASA...
research
10/20/2021

Asynchronous parareal time discretization for partial differential equations

Asynchronous iterations are more and more investigated for both scaling ...
research
07/02/2019

Convergence Detection of Asynchronous Iterations based on Modified Recursive Doubling

This paper addresses the distributed convergence detection problem in as...
research
08/04/2015

Asynchronous stochastic convex optimization

We show that asymptotically, completely asynchronous stochastic gradient...
research
06/25/2018

A Distributed Flexible Delay-tolerant Proximal Gradient Algorithm

We develop and analyze an asynchronous algorithm for distributed convex ...
research
06/30/2022

JACK2: a new high-level communication library for parallel iterative methods

In this paper, we address the problem of designing a distributed applica...

Please sign up or login with your details

Forgot password? Click here to reset