Asynchronous Richardson iterations

09/04/2020
by   Edmond Chow, et al.
0

We consider asynchronous versions of the first and second order Richardson methods for solving linear systems of equations. These methods depend on parameters whose values are chosen a priori. We explore the parameter values that can be proven to give convergence of the asynchronous methods. This is the first such analysis for asynchronous second order methods. We find that for the first order method, the optimal parameter value for the synchronous case also gives an asynchronously convergent method. For the second order method, the parameter ranges for which we can prove asynchronous convergence do not contain the optimal parameter values for the synchronous iteration. In practice, however, the asynchronous second order iterations may still converge using the optimal parameter values, or parameter values close to the optimal ones, despite this result. We explore this behavior with a multithreaded parallel implementation of the asynchronous methods.

READ FULL TEXT
research
08/17/2017

More Iterations per Second, Same Quality -- Why Asynchronous Algorithms may Drastically Outperform Traditional Ones

In this paper, we consider the convergence of a very general asynchronou...
research
09/29/2021

Delayed Asynchronous Iterative Graph Algorithms

Iterative graph algorithms often compute intermediate values and update ...
research
12/03/2020

Dynamic Asynchronous Iterations

Many problems can be solved by iteration by multiple participants (proce...
research
05/22/2017

An Asynchronous Distributed Framework for Large-scale Learning Based on Parameter Exchanges

In many distributed learning problems, the heterogeneous loading of comp...
research
07/02/2019

Convergence Detection of Asynchronous Iterations based on Modified Recursive Doubling

This paper addresses the distributed convergence detection problem in as...
research
05/30/2023

Flexible Enlarged Conjugate Gradient Methods

Enlarged Krylov subspace methods and their s-step versions were introduc...

Please sign up or login with your details

Forgot password? Click here to reset