Adapt to Adaptation: Learning Personalization for Cross-Silo Federated Learning

10/15/2021
by   Jun Luo, et al.
0

The goal of conventional federated learning (FL) is to train a global model for a federation of clients with decentralized data, reducing the systemic privacy risk of centralized training. The distribution shift across non-IID datasets, also known as the data heterogeneity, often poses a challenge for this one-global-model-fits-all solution. In this work, we propose APPLE, a personalized cross-silo FL framework that adaptively learns how much each client can benefit from other clients' models. We also introduce a method to flexibly control the focus of training APPLE between global and local objectives. We empirically evaluate our method's convergence and generalization behavior and performed extensive experiments on two benchmark datasets and two medical imaging datasets under two non-IID settings. The results show that the proposed personalized FL framework, APPLE, achieves state-of-the-art performance compared to several other personalized FL approaches in the literature.

READ FULL TEXT

page 7

page 13

research
06/16/2020

Personalized Federated Learning with Moreau Envelopes

Federated learning (FL) is a decentralized and privacy-preserving machin...
research
11/21/2022

Exploiting Personalized Invariance for Better Out-of-distribution Generalization in Federated Learning

Recently, data heterogeneity among the training datasets on the local cl...
research
11/16/2021

Inference-Time Personalized Federated Learning

In Federated learning (FL), multiple clients collaborate to learn a mode...
research
01/17/2023

FedCliP: Federated Learning with Client Pruning

The prevalent communication efficient federated learning (FL) frameworks...
research
07/16/2021

Federated Whole Prostate Segmentation in MRI with Personalized Neural Architectures

Building robust deep learning-based models requires diverse training dat...
research
08/23/2021

Federated Multi-Task Learning under a Mixture of Distributions

The increasing size of data generated by smartphones and IoT devices mot...
research
03/18/2022

Closing the Generalization Gap of Cross-silo Federated Medical Image Segmentation

Cross-silo federated learning (FL) has attracted much attention in medic...

Please sign up or login with your details

Forgot password? Click here to reset