A Novel Optimized Asynchronous Federated Learning Framework

11/18/2021
by   Zhicheng Zhou, et al.
19

Federated Learning (FL) since proposed has been applied in many fields, such as credit assessment, medical, etc. Because of the difference in the network or computing resource, the clients may not update their gradients at the same time that may take a lot of time to wait or idle. That's why Asynchronous Federated Learning (AFL) method is needed. The main bottleneck in AFL is communication. How to find a balance between the model performance and the communication cost is a challenge in AFL. This paper proposed a novel AFL framework VAFL. And we verified the performance of the algorithm through sufficient experiments. The experiments show that VAFL can reduce the communication times about 51.02% with 48.23% average communication compression rate and allow the model to be converged faster. The code is available at <https://github.com/RobAI-Lab/VAFL>

READ FULL TEXT
research
11/17/2022

Improving Federated Learning Communication Efficiency with Global Momentum Fusion for Gradient Compression Schemes

Communication costs within Federated learning hinder the system scalabil...
research
10/12/2020

FedAT: A Communication-Efficient Federated Learning Method with Asynchronous Tiers under Non-IID Data

Federated learning (FL) involves training a model over massive distribut...
research
01/10/2022

Communication-Efficient Federated Learning with Acceleration of Global Momentum

Federated learning often suffers from unstable and slow convergence due ...
research
02/27/2023

FedCLIP: Fast Generalization and Personalization for CLIP in Federated Learning

Federated learning (FL) has emerged as a new paradigm for privacy-preser...
research
08/18/2022

FedComm: Understanding Communication Protocols for Edge-based Federated Learning

Federated learning (FL) trains machine learning (ML) models on devices u...
research
11/29/2021

Anomaly Localization in Model Gradients Under Backdoor Attacks Against Federated Learning

Inserting a backdoor into the joint model in federated learning (FL) is ...
research
03/05/2021

Federated Learning with Randomized Douglas-Rachford Splitting Methods

In this paper, we develop two new algorithms, called, FedDR and asyncFed...

Please sign up or login with your details

Forgot password? Click here to reset