EFFGAN: Ensembles of fine-tuned federated GANs

06/23/2022
by   Ebba Ekblom, et al.
0

Generative adversarial networks have proven to be a powerful tool for learning complex and high-dimensional data distributions, but issues such as mode collapse have been shown to make it difficult to train them. This is an even harder problem when the data is decentralized over several clients in a federated learning setup, as problems such as client drift and non-iid data make it hard for federated averaging to converge. In this work, we study the task of how to learn a data distribution when training data is heterogeneously decentralized over clients and cannot be shared. Our goal is to sample from this distribution centrally, while the data never leaves the clients. We show using standard benchmark image datasets that existing approaches fail in this setting, experiencing so-called client drift when the local number of epochs becomes to large. We thus propose a novel approach we call EFFGAN: Ensembles of fine-tuned federated GANs. Being an ensemble of local expert generators, EFFGAN is able to learn the data distribution over all clients and mitigate client drift. It is able to train with a large number of local epochs, making it more communication efficient than previous works.

READ FULL TEXT
research
10/12/2022

Find Your Friends: Personalized Federated Learning with the Right Collaborators

In the traditional federated learning setting, a central server coordina...
research
05/23/2019

Decentralized Learning of Generative Adversarial Networks from Multi-Client Non-iid Data

This work addresses a new problem of learning generative adversarial net...
research
07/18/2021

Decentralized federated learning of deep neural networks on non-iid data

We tackle the non-convex problem of learning a personalized deep learnin...
research
08/16/2021

Fine-tuning is Fine in Federated Learning

We study the performance of federated learning algorithms and their vari...
research
10/14/2019

SCAFFOLD: Stochastic Controlled Averaging for On-Device Federated Learning

Federated learning is a key scenario in modern large-scale machine learn...
research
05/01/2023

Scalable Data Point Valuation in Decentralized Learning

Existing research on data valuation in federated and swarm learning focu...
research
05/07/2020

Federated Generative Adversarial Learning

This work studies training generative adversarial networks under the fed...

Please sign up or login with your details

Forgot password? Click here to reset