A Fundamental Tradeoff Among Storage, Computation, and Communication for Distributed Computing over Star Network

01/10/2023
by   Qifa Yan, et al.
0

Coded distributed computing can alleviate the communication load by leveraging the redundant storage and computation resources with coding techniques in distributed computing. In this paper, we study a MapReduce-type distributed computing framework over star topological network, where all the workers exchange information through a common access point. The optimal tradeoff among the normalized number of the stored files (storage load), computed intermediate values (computation load) and transmitted bits in the uplink and downlink (communication loads) are characterized. A coded computing scheme is proposed to achieve the Pareto-optimal tradeoff surface, in which the access point only needs to perform simple chain coding between the signals it receives, and information-theretical bound matching the surface is also provided.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/26/2018

A Storage-Computation-Communication Tradeoff for Distributed Computing

This paper investigates distributed computing systems where computations...
research
06/20/2018

Storage, Computation, and Communication: A Fundamental Tradeoff in Distributed Computing

We consider a MapReduce-like distributed computing system. We derive a l...
research
01/23/2019

A Fundamental Storage-Communication Tradeoff in Distributed Computing with Straggling Nodes

The optimal storage-computation tradeoff is characterized for a MapReduc...
research
08/20/2020

A Survey of Coded Distributed Computing

Distributed computing has become a common approach for large-scale compu...
research
04/09/2020

Topological Coded Distributed Computing

This paper considers the MapReduce-like coded distributed computing fram...
research
05/05/2018

Compressed Coded Distributed Computing

Communication overhead is one of the major performance bottlenecks in la...
research
08/19/2019

Heterogeneous Coded Distributed Computing: Joint Design of File Allocation and Function Assignment

This paper studies the computation-communication tradeoff in a heterogen...

Please sign up or login with your details

Forgot password? Click here to reset