Accelerating Federated Edge Learning via Optimized Probabilistic Device Scheduling

07/24/2021
by   Maojun Zhang, et al.
0

The popular federated edge learning (FEEL) framework allows privacy-preserving collaborative model training via frequent learning-updates exchange between edge devices and server. Due to the constrained bandwidth, only a subset of devices can upload their updates at each communication round. This has led to an active research area in FEEL studying the optimal device scheduling policy for minimizing communication time. However, owing to the difficulty in quantifying the exact communication time, prior work in this area can only tackle the problem partially by considering either the communication rounds or per-round latency, while the total communication time is determined by both metrics. To close this gap, we make the first attempt in this paper to formulate and solve the communication time minimization problem. We first derive a tight bound to approximate the communication time through cross-disciplinary effort involving both learning theory for convergence analysis and communication theory for per-round latency analysis. Building on the analytical result, an optimized probabilistic scheduling policy is derived in closed-form by solving the approximate communication time minimization problem. It is found that the optimized policy gradually turns its priority from suppressing the remaining communication rounds to reducing per-round latency as the training process evolves. The effectiveness of the proposed scheme is demonstrated via a use case on collaborative 3D objective detection in autonomous driving.

READ FULL TEXT

page 1

page 4

research
11/03/2019

Device Scheduling with Fast Convergence for Wireless Federated Learning

Owing to the increasing need for massive data analysis and model trainin...
research
04/01/2020

Scheduling in Cellular Federated Edge Learning with Importance and Channel Awareness

In cellular federated edge learning (FEEL), multiple edge devices holdin...
research
12/29/2021

Training Time Minimization for Federated Edge Learning with Optimized Gradient Quantization and Bandwidth Allocation

Training a machine learning model with federated edge learning (FEEL) is...
research
01/27/2022

Data-Quality Based Scheduling for Federated Edge Learning

FEderated Edge Learning (FEEL) has emerged as a leading technique for pr...
research
02/18/2021

Data-Aware Device Scheduling for Federated Edge Learning

Federated Edge Learning (FEEL) involves the collaborative training of ma...
research
05/02/2023

Dynamic Scheduling for Federated Edge Learning with Streaming Data

In this work, we consider a Federated Edge Learning (FEEL) system where ...
research
05/05/2023

Over-the-Air Federated Averaging with Limited Power and Privacy Budgets

To jointly overcome the communication bottleneck and privacy leakage of ...

Please sign up or login with your details

Forgot password? Click here to reset