Optimization-Based GenQSGD for Federated Edge Learning

10/25/2021
by   Yangchen Li, et al.
0

Optimal algorithm design for federated learning (FL) remains an open problem. This paper explores the full potential of FL in practical edge computing systems where workers may have different computation and communication capabilities, and quantized intermediate model updates are sent between the server and workers. First, we present a general quantized parallel mini-batch stochastic gradient descent (SGD) algorithm for FL, namely GenQSGD, which is parameterized by the number of global iterations, the numbers of local iterations at all workers, and the mini-batch size. We also analyze its convergence error for any choice of the algorithm parameters. Then, we optimize the algorithm parameters to minimize the energy cost under the time constraint and convergence error constraint. The optimization problem is a challenging non-convex problem with non-differentiable constraint functions. We propose an iterative algorithm to obtain a KKT point using advanced optimization techniques. Numerical results demonstrate the significant gains of GenQSGD over existing FL algorithms and reveal the importance of optimally designing FL algorithms.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/26/2021

An Optimization Framework for Federated Edge Learning

The optimal design of federated learning (FL) algorithms for solving gen...
research
06/13/2023

GQFedWAvg: Optimization-Based Quantized Federated Learning in General Edge Computing Systems

The optimal implementation of federated learning (FL) in practical edge ...
research
11/01/2019

Energy-Aware Analog Aggregation for Federated Learning with Redundant Data

Federated learning (FL) enables workers to learn a model collaboratively...
research
10/31/2022

A-LAQ: Adaptive Lazily Aggregated Quantized Gradient

Federated Learning (FL) plays a prominent role in solving machine learni...
research
05/22/2020

FedPD: A Federated Learning Framework with Optimal Rates and Adaptivity to Non-IID Data

Federated Learning (FL) has become a popular paradigm for learning from ...
research
08/23/2021

Anarchic Federated Learning

Present-day federated learning (FL) systems deployed over edge networks ...
research
01/21/2021

Rate Region for Indirect Multiterminal Source Coding in Federated Learning

One of the main focus in federated learning (FL) is the communication ef...

Please sign up or login with your details

Forgot password? Click here to reset