Wireless MapReduce Distributed Computing

02/03/2018
by   Fan Li, et al.
0

Motivated by mobile edge computing and wireless data centers, we study a wireless distributed computing framework where the distributed nodes exchange information over a wireless interference network. Following the structure of MapReduce, this framework consists of Map, Shuffle, and Reduce phases, where Map and Reduce are computation phases and Shuffle is a data transmission phase operated over a wireless interference network. By duplicating the computation work at a cluster of distributed nodes in the Map phase, one can reduce the amount of transmission load required for the Shuffle phase. In this work, we characterize the fundamental tradeoff between computation load and communication load, under the assumption of one-shot linear schemes. The proposed scheme is based on side information cancellation and zero-forcing, and turns out to be optimal. The proposed scheme outperforms the naive TDMA scheme with single node transmission at a time, as well as the coded TDMA scheme that allows coding across data, in terms of the computation-communication tradeoff.

READ FULL TEXT
research
02/01/2018

Distributed Computing with Heterogeneous Communication Constraints: The Worst-Case Computation Load and Proof by Contradiction

We consider a distributed computing framework where the distributed node...
research
01/17/2018

Coded Computing for Distributed Graph Analytics

Many distributed graph computing systems have been developed recently fo...
research
10/29/2019

The Tradeoff Between Coverage and Computation in Wireless Networks

We consider a distributed edge computing scenario consisting of several ...
research
10/25/2018

Wireless Map-Reduce Distributed Computing with Full-Duplex Radios and Imperfect CSI

Consider a distributed computing system in which the worker nodes are co...
research
01/15/2020

Low Complexity Distributed Computing via Binary Matrices with Extension to Stragglers

We consider the distributed computing framework of Map-Reduce, which con...
research
02/09/2018

Communication-Computation Efficient Gradient Coding

This paper develops coding techniques to reduce the running time of dist...
research
03/07/2021

Joint Coding and Scheduling Optimization for Distributed Learning over Wireless Edge Networks

Unlike theoretical distributed learning (DL), DL over wireless edge netw...

Please sign up or login with your details

Forgot password? Click here to reset