Joint Coding and Scheduling Optimization for Distributed Learning over Wireless Edge Networks

03/07/2021
by   Nguyen Van Huynh, et al.
0

Unlike theoretical distributed learning (DL), DL over wireless edge networks faces the inherent dynamics/uncertainty of wireless connections and edge nodes, making DL less efficient or even inapplicable under the highly dynamic wireless edge networks (e.g., using mmW interfaces). This article addresses these problems by leveraging recent advances in coded computing and the deep dueling neural network architecture. By introducing coded structures/redundancy, a distributed learning task can be completed without waiting for straggling nodes. Unlike conventional coded computing that only optimizes the code structure, coded distributed learning over the wireless edge also requires to optimize the selection/scheduling of wireless edge nodes with heterogeneous connections, computing capability, and straggling effects. However, even neglecting the aforementioned dynamics/uncertainty, the resulting joint optimization of coding and scheduling to minimize the distributed learning time turns out to be NP-hard. To tackle this and to account for the dynamics and uncertainty of wireless connections and edge nodes, we reformulate the problem as a Markov Decision Process and then design a novel deep reinforcement learning algorithm that employs the deep dueling neural network architecture to find the jointly optimal coding scheme and the best set of edge nodes for different learning tasks without explicit information about the wireless environment and edge nodes' straggling parameters. Simulations show that the proposed framework reduces the average learning delay in wireless edge computing up to 66 framework in this article is also applicable to any distributed learning scheme with heterogeneous and uncertain computing nodes.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/10/2021

Jointly Optimize Coding and Node Selection for Distributed Computing over Wireless Edge Networks

This work aims to jointly optimize the coding and node selection to mini...
research
02/03/2018

Wireless MapReduce Distributed Computing

Motivated by mobile edge computing and wireless data centers, we study a...
research
08/26/2019

A Deep Reinforcement Learning Approach to Multi-component Job Scheduling in Edge Computing

We are interested in the optimal scheduling of a collection of multi-com...
research
02/07/2020

Delay-Optimal Distributed Edge Computing in Wireless Edge Networks

By integrating edge computing with parallel computing, distributed edge ...
research
04/12/2019

Distributed Deep Learning Model for Intelligent Video Surveillance Systems with Edge Computing

In this paper, we propose a Distributed Intelligent Video Surveillance (...
research
04/11/2019

On Model Coding for Distributed Inference and Transmission in Mobile Edge Computing Systems

Consider a mobile edge computing system in which users wish to obtain th...
research
01/16/2019

Coded Federated Computing in Wireless Networks with Straggling Devices and Imperfect CSI

Distributed computing platforms typically assume the availability of rel...

Please sign up or login with your details

Forgot password? Click here to reset