Adaptive Task Allocation for Asynchronous Federated Mobile Edge Learning

05/05/2019
by   Umair Mohammad, et al.
0

This paper proposes a scheme to efficiently execute distributed learning tasks in an asynchronous manner while minimizing the gradient staleness on wireless edge nodes with heterogeneous computing and communication capacities. The designed approach considered in this paper ensures that all devices work for a certain duration that covers the time for data/model distribution, learning iterations, model collection and global aggregation. The resulting problem is an integer non-convex program with quadratic equality constraints as well as linear equality and inequality constraints. Because the problem is NP-hard, we relax the integer constraints in order to solve it efficiently with available solvers. Analytical bounds are derived using the KKT conditions and Lagrangian analysis in conjunction with the suggest-and-improve approach. Results show that our approach reduces the gradient staleness and can offer better accuracy than the synchronous scheme and the asynchronous scheme with equal task allocation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/09/2018

Adaptive Task Allocation for Mobile Edge Learning

This paper aims to establish a new optimization paradigm for implementin...
research
11/30/2020

Task Allocation for Asynchronous Mobile Edge Learning with Delay and Energy Constraints

This paper extends the paradigm of "mobile edge learning (MEL)" by desig...
research
12/09/2021

Asynchronous Semi-Decentralized Federated Edge Learning for Heterogeneous Clients

Federated edge learning (FEEL) has drawn much attention as a privacy-pre...
research
10/03/2019

SAFA: a Semi-Asynchronous Protocol for Fast Federated Learning with Low Overhead

Federated learning (FL) has attracted increasing attention as a promisin...
research
03/02/2020

Distribution Constraints: The Chase for Distributed Data

This paper introduces a declarative framework to specify and reason abou...
research
05/06/2023

Semi-Asynchronous Federated Edge Learning Mechanism via Over-the-air Computation

Over-the-air Computation (AirComp) has been demonstrated as an effective...
research
04/17/2020

An Asynchronous Computability Theorem for Fair Adversaries

This paper proposes a simple topological characterization of a large cla...

Please sign up or login with your details

Forgot password? Click here to reset