Deep Unfolding-based Weighted Averaging for Federated Learning under Heterogeneous Environments

12/23/2022
by   Ayano Nakai-Kasai, et al.
0

Federated learning is a collaborative model training method by iterating model updates at multiple clients and aggregation of the updates at a central server. Device and statistical heterogeneity of the participating clients cause performance degradation so that an appropriate weight should be assigned per client in the server's aggregation phase. This paper employs deep unfolding to learn the weights that adapt to the heterogeneity, which gives the model with high accuracy on uniform test data. The results of numerical experiments indicate the high performance of the proposed method and the interpretable behavior of the learned weights.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/17/2021

Aggregation Delayed Federated Learning

Federated learning is a distributed machine learning paradigm where mult...
research
06/30/2023

Improving Federated Aggregation with Deep Unfolding Networks

The performance of Federated learning (FL) is negatively affected by dev...
research
02/23/2022

Bitwidth Heterogeneous Federated Learning with Progressive Weight Dequantization

In practical federated learning scenarios, the participating devices may...
research
12/14/2022

FedSkip: Combatting Statistical Heterogeneity with Federated Skip Aggregation

The statistical heterogeneity of the non-independent and identically dis...
research
07/13/2023

A Case for Offloading Federated Learning Server on Smart NIC

Federated learning is a distributed machine learning approach where loca...
research
02/25/2020

Device Heterogeneity in Federated Learning: A Superquantile Approach

We propose a federated learning framework to handle heterogeneous client...
research
06/09/2022

HideNseek: Federated Lottery Ticket via Server-side Pruning and Sign Supermask

Federated learning alleviates the privacy risk in distributed learning b...

Please sign up or login with your details

Forgot password? Click here to reset