Distributed function estimation: adaptation using minimal communication

03/28/2020
by   Botond Szabo, et al.
0

We investigate whether in a distributed setting, adaptive estimation of a smooth function at the optimal rate is possible under minimal communication. It turns out that the answer depends on the risk considered and on the number of servers over which the procedure is distributed. We show that for the L_∞-risk, adaptively obtaining optimal rates under minimal communication is not possible. For the L_2-risk, it is possible over a range of regularities that depends on the relation between the number of local servers and the total sample size.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/04/2018

Distributed Nonparametric Regression under Communication Constraints

This paper studies the problem of nonparametric estimation of a smooth f...
research
07/01/2021

Distributed Nonparametric Function Estimation: Optimal Rate of Convergence and Cost of Adaptation

Distributed minimax estimation and distributed adaptive estimation under...
research
01/24/2020

Distributed Gaussian Mean Estimation under Communication Constraints: Optimal Rates and Communication-Efficient Algorithms

We study distributed estimation of a Gaussian mean under communication c...
research
04/17/2018

Reaching Distributed Equilibrium with Limited ID Space

We examine the relation between the size of the id space and the number ...
research
10/20/2022

Local SGD in Overparameterized Linear Regression

We consider distributed learning using constant stepsize SGD (DSGD) over...
research
04/14/2020

Comparisons of Algorithms in Big Data Processing

Parallel computing is the fundamental base for MapReduce framework in Ha...
research
01/09/2023

Multi-User Distributed Computing Via Compressed Sensing

The multi-user linearly-separable distributed computing problem is consi...

Please sign up or login with your details

Forgot password? Click here to reset