Distributed Picard Iteration

03/31/2021
by   Francisco L. Andrade, et al.
0

The Picard iteration is widely used to find fixed points of locally contractive (LC) maps. This paper extends the Picard iteration to distributed settings; specifically, we assume the map of which the fixed point is sought to be the average of individual (not necessarily LC) maps held by a set of agents linked by a sparse communication network. An additional difficulty is that the LC map is not assumed to come from an underlying optimization problem, which prevents exploiting strong global properties such as convexity or Lipschitzianity. Yet, we propose a distributed algorithm and prove its convergence, in fact showing that it maintains the linear rate of the standard Picard iteration for the average LC map. As another contribution, our proof imports tools from perturbation theory of linear operators, which, to the best of our knowledge, had not been used before in the theory of distributed computation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/20/2021

Distributed Picard Iteration: Application to Distributed EM and Distributed PCA

In recent work, we proposed a distributed Picard iteration (DPI) that al...
research
01/12/2020

Distributed Fixed Point Method for Solving Systems of Linear Algebraic Equations

We present a class of iterative fully distributed fixed point methods to...
research
07/29/2021

DCG: Distributed Conjugate Gradient for Efficient Linear Equations Solving

Distributed algorithms to solve linear equations in multi-agent networks...
research
04/03/2020

From Local SGD to Local Fixed Point Methods for Federated Learning

Most algorithms for solving optimization problems or finding saddle poin...
research
07/28/2014

'Almost Sure' Chaotic Properties of Machine Learning Methods

It has been demonstrated earlier that universal computation is 'almost s...
research
09/09/2019

A fixed-point policy-iteration-type algorithm for symmetric nonzero-sum stochastic impulse games

Nonzero-sum stochastic differential games with impulse controls offer a ...

Please sign up or login with your details

Forgot password? Click here to reset