Asynchronous Richardson iterations

09/04/2020
by   Edmond Chow, et al.
0

We consider asynchronous versions of the first and second order Richardson methods for solving linear systems of equations. These methods depend on parameters whose values are chosen a priori. We explore the parameter values that can be proven to give convergence of the asynchronous methods. This is the first such analysis for asynchronous second order methods. We find that for the first order method, the optimal parameter value for the synchronous case also gives an asynchronously convergent method. For the second order method, the parameter ranges for which we can prove asynchronous convergence do not contain the optimal parameter values for the synchronous iteration. In practice, however, the asynchronous second order iterations may still converge using the optimal parameter values, or parameter values close to the optimal ones, despite this result. We explore this behavior with a multithreaded parallel implementation of the asynchronous methods.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 8

08/17/2017

More Iterations per Second, Same Quality -- Why Asynchronous Algorithms may Drastically Outperform Traditional Ones

In this paper, we consider the convergence of a very general asynchronou...
09/29/2021

Delayed Asynchronous Iterative Graph Algorithms

Iterative graph algorithms often compute intermediate values and update ...
12/03/2020

Dynamic Asynchronous Iterations

Many problems can be solved by iteration by multiple participants (proce...
05/22/2017

An Asynchronous Distributed Framework for Large-scale Learning Based on Parameter Exchanges

In many distributed learning problems, the heterogeneous loading of comp...
07/02/2019

Convergence Detection of Asynchronous Iterations based on Modified Recursive Doubling

This paper addresses the distributed convergence detection problem in as...
02/15/2022

A Light-Weight Multi-Objective Asynchronous Hyper-Parameter Optimizer

We describe a light-weight yet performant system for hyper-parameter opt...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.