Geometric Bounds for Convergence Rates of Averaging Algorithms

07/09/2020
by   Bernadette Charron-Bost, et al.
0

We develop a generic method for bounding the convergence rate of an averaging algorithm running in a multi-agent system with a time-varying network, where the associated stochastic matrices have a time-independent Perron vector. This method provides bounds on convergence rates that unify and refine most of the previously known bounds. They depend on geometric parameters of the dynamic communication graph such as the normalized diameter or the bottleneck measure. As corollaries of these geometric bounds, we show that the convergence rate of the Metropolis algorithm in a system of n agents is less than 1-1/4n^2 with any communication graph that may vary in time, but is permanently connected and bidirectional. We prove a similar upper bound for the EqualNeighbor algorithm under the additional assumptions that the number of neighbors of each agent is constant and that the communication graph is not too irregular. Moreover our bounds offer improved convergence rates for several averaging algorithms and specific families of communication graphs. Finally we extend our methodology to a time-varying Perron vector and show how convergence times may dramatically degrade with even limited variations of Perron vectors.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/06/2020

Exact Convergence Rate Analysis of the Independent Metropolis-Hastings Algorithms

A well-known difficult problem regarding Metropolis-Hastings algorithms ...
research
10/27/2021

A Law of Iterated Logarithm for Multi-Agent Reinforcement Learning

In Multi-Agent Reinforcement Learning (MARL), multiple agents interact w...
research
03/22/2020

Fully distributed Nash equilibrium seeking over time-varying communication networks with linear convergence rate

We design a distributed algorithm for learning Nash equilibria over time...
research
02/23/2020

Finite-Time Last-Iterate Convergence for Multi-Agent Learning in Games

We consider multi-agent learning via online gradient descent (OGD) in a ...
research
07/12/2023

Low complexity convergence rate bounds for the synchronous gossip subclass of push-sum algorithms

We develop easily accessible quantities for bounding the almost sure exp...
research
04/30/2019

Convergence rates for ordinal embedding

We prove optimal bounds for the convergence rate of ordinal embedding (a...
research
09/01/2020

Variational Regularization Theory Based on Image Space Approximation Rates

We present a new approach to convergence rate results for variational re...

Please sign up or login with your details

Forgot password? Click here to reset