FedMix: Approximation of Mixup under Mean Augmented Federated Learning

07/01/2021
by   Tehrim Yoon, et al.
0

Federated learning (FL) allows edge devices to collectively learn a model without directly sharing data within each device, thus preserving privacy and eliminating the need to store data globally. While there are promising results under the assumption of independent and identically distributed (iid) local data, current state-of-the-art algorithms suffer from performance degradation as the heterogeneity of local data across clients increases. To resolve this issue, we propose a simple framework, Mean Augmented Federated Learning (MAFL), where clients send and receive averaged local data, subject to the privacy requirements of target applications. Under our framework, we propose a new augmentation algorithm, named FedMix, which is inspired by a phenomenal yet simple data augmentation method, Mixup, but does not require local raw data to be directly shared among devices. Our method shows greatly improved performance in the standard benchmark datasets of FL, under highly non-iid federated settings, compared to conventional algorithms.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/09/2022

Local Learning Matters: Rethinking Data Heterogeneity in Federated Learning

Federated learning (FL) is a promising strategy for performing privacy-p...
research
06/09/2020

XOR Mixup: Privacy-Preserving Data Augmentation for One-Shot Federated Learning

User-generated data distributions are often imbalanced across devices an...
research
02/15/2023

A Federated Learning Benchmark for Drug-Target Interaction

Aggregating pharmaceutical data in the drug-target interaction (DTI) dom...
research
08/29/2022

Federated Zero-Shot Learning with Mid-Level Semantic Knowledge Transfer

Conventional centralised deep learning paradigms are not feasible when d...
research
06/20/2022

Mitigating Data Heterogeneity in Federated Learning with Data Augmentation

Federated Learning (FL) is a prominent framework that enables training a...
research
02/07/2022

FL_PyTorch: optimization research simulator for federated learning

Federated Learning (FL) has emerged as a promising technique for edge de...
research
12/02/2022

Generative Data Augmentation for Non-IID Problem in Decentralized Clinical Machine Learning

Swarm learning (SL) is an emerging promising decentralized machine learn...

Please sign up or login with your details

Forgot password? Click here to reset