Improved Communication Efficiency for Distributed Mean Estimation with Side Information

02/04/2021
by   Kai Liang, et al.
0

In this paper, we consider the distributed mean estimation problem where the server has access to some side information, e.g., its local computed mean estimation or the received information sent by the distributed clients at the previous iterations. We propose a practical and efficient estimator based on an r-bit Wynzer-Ziv estimator proposed by Mayekar et al., which requires no probabilistic assumption on the data. Unlike Mayekar's work which only utilizes side information at the server, our scheme jointly exploits the correlation between clients' data and server' s side information, and also between data of different clients. We derive an upper bound of the estimation error of the proposed estimator. Based on this upper bound, we provide two algorithms on how to choose input parameters for the estimator. Finally, parameter regions in which our estimator is better than the previous one are characterized.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/24/2020

Wyner-Ziv Estimators: Efficient Distributed Mean Estimation with Side Information

Communication efficient distributed mean estimation is an important prim...
research
06/22/2018

Removing the Curse of Superefficiency: an Effective Strategy For Distributed Computing in Isotonic Regression

We propose a strategy for computing the isotonic least-squares estimate ...
research
08/10/2020

Improved Bounds for Distributed Load Balancing

In the load balancing problem, the input is an n-vertex bipartite graph ...
research
04/23/2021

Decentralized Federated Averaging

Federated averaging (FedAvg) is a communication efficient algorithm for ...
research
08/05/2022

Kendall's tau estimator for bivariate zero-inflated count data

In this paper, we extend the work of Pimentel et al. (2015) and propose ...
research
12/11/2022

Client Selection for Federated Bayesian Learning

Distributed Stein Variational Gradient Descent (DSVGD) is a non-parametr...
research
07/29/2009

Cooperative Training for Attribute-Distributed Data: Trade-off Between Data Transmission and Performance

This paper introduces a modeling framework for distributed regression wi...

Please sign up or login with your details

Forgot password? Click here to reset