A Fundamental Storage-Communication Tradeoff in Distributed Computing with Straggling Nodes

01/23/2019
by   Qifa Yan, et al.
0

The optimal storage-computation tradeoff is characterized for a MapReduce-like distributed computing system with straggling nodes, where only a part of the nodes can be utilized to compute the desired output functions. The result holds for arbitrary output functions and thus generalizes previous results that restricted to linear functions. Specifically, in this work, we propose a new information-theoretical converse and a new matching coded computing scheme, that we call coded computing for straggling systems (CCS).

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset