DeepAI AI Chat
Log In Sign Up

Improved Communication Efficiency for Distributed Mean Estimation with Side Information

02/04/2021
by   Kai Liang, et al.
0

In this paper, we consider the distributed mean estimation problem where the server has access to some side information, e.g., its local computed mean estimation or the received information sent by the distributed clients at the previous iterations. We propose a practical and efficient estimator based on an r-bit Wynzer-Ziv estimator proposed by Mayekar et al., which requires no probabilistic assumption on the data. Unlike Mayekar's work which only utilizes side information at the server, our scheme jointly exploits the correlation between clients' data and server' s side information, and also between data of different clients. We derive an upper bound of the estimation error of the proposed estimator. Based on this upper bound, we provide two algorithms on how to choose input parameters for the estimator. Finally, parameter regions in which our estimator is better than the previous one are characterized.

READ FULL TEXT

page 1

page 2

page 3

page 4

11/24/2020

Wyner-Ziv Estimators: Efficient Distributed Mean Estimation with Side Information

Communication efficient distributed mean estimation is an important prim...
06/22/2018

Removing the Curse of Superefficiency: an Effective Strategy For Distributed Computing in Isotonic Regression

We propose a strategy for computing the isotonic least-squares estimate ...
08/10/2020

Improved Bounds for Distributed Load Balancing

In the load balancing problem, the input is an n-vertex bipartite graph ...
04/23/2021

Decentralized Federated Averaging

Federated averaging (FedAvg) is a communication efficient algorithm for ...
08/05/2022

Kendall's tau estimator for bivariate zero-inflated count data

In this paper, we extend the work of Pimentel et al. (2015) and propose ...
07/29/2009

Cooperative Training for Attribute-Distributed Data: Trade-off Between Data Transmission and Performance

This paper introduces a modeling framework for distributed regression wi...
12/11/2022

Client Selection for Federated Bayesian Learning

Distributed Stein Variational Gradient Descent (DSVGD) is a non-parametr...