Gossip of Statistical Observations using Orthogonal Polynomials

05/22/2018
by   Raphaël Berthier, et al.
0

Consider a network of agents connected by communication links, where each agent holds a real value. The gossip problem consists in estimating the average of the values diffused in the network in a distributed manner. Current techniques for gossiping are designed to deal with worst-case scenarios, which is irrelevant in applications to distributed statistical learning and denoising in sensor networks. We design second-order gossip methods tailor-made for the case where the real values are i.i.d. samples from the same distribution. In some regular network structures, we are able to prove optimality of our methods, and simulations suggest that they are efficient in a wide range of random networks. Our approach of gossip stems from a new acceleration framework using the family of orthogonal polynomials with respect to the spectral measure of the network graph.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/16/2023

Polynomial and rational measure modifications of orthogonal polynomials via infinite-dimensional banded matrix factorizations

We describe fast algorithms for approximating the connection coefficient...
research
12/23/2021

Hermite–Padé approximations with Pfaffian structures: Novikov peakon equation and integrable lattices

Motivated by the Novikov equation and its peakon problem, we propose a n...
research
03/26/2021

Automated Worst-Case Performance Analysis of Decentralized Gradient Descent

We develop a methodology to automatically compute worst-case performance...
research
05/29/2018

Representational Power of ReLU Networks and Polynomial Kernels: Beyond Worst-Case Analysis

There has been a large amount of interest, both in the past and particul...
research
06/08/2020

Halting Time is Predictable for Large Models: A Universality Property and Average-case Analysis

Average-case analysis computes the complexity of an algorithm averaged o...

Please sign up or login with your details

Forgot password? Click here to reset