FACT: Federated Adversarial Cross Training

06/01/2023
by   Stefan Schrod, et al.
0

Federated Learning (FL) facilitates distributed model development to aggregate multiple confidential data sources. The information transfer among clients can be compromised by distributional differences, i.e., by non-i.i.d. data. A particularly challenging scenario is the federated model adaptation to a target client without access to annotated data. We propose Federated Adversarial Cross Training (FACT), which uses the implicit domain differences between source clients to identify domain shifts in the target domain. In each round of FL, FACT cross initializes a pair of source clients to generate domain specialized representations which are then used as a direct adversary to learn a domain invariant data representation. We empirically show that FACT outperforms state-of-the-art federated, non-federated and source-free domain adaptation models on three popular multi-source-single-target benchmarks, and state-of-the-art Unsupervised Domain Adaptation (UDA) models on single-source-single-target experiments. We further study FACT's behavior with respect to communication restrictions and the number of participating clients.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/22/2022

Multi-Source Domain Adaptation Based on Federated Knowledge Alignment

Federated Learning (FL) facilitates distributed model learning to protec...
research
11/16/2021

Inference-Time Personalized Federated Learning

In Federated learning (FL), multiple clients collaborate to learn a mode...
research
02/10/2023

Federated Domain Adaptation via Gradient Projection

Federated Domain Adaptation (FDA) describes the federated learning setti...
research
09/14/2023

Federated Dataset Dictionary Learning for Multi-Source Domain Adaptation

In this article, we propose an approach for federated domain adaptation,...
research
04/24/2023

Multi-Source to Multi-Target Decentralized Federated Domain Adaptation

Heterogeneity across devices in federated learning (FL) typically refers...
research
05/11/2021

Separate but Together: Unsupervised Federated Learning for Speech Enhancement from Non-IID Data

We propose FEDENHANCE, an unsupervised federated learning (FL) approach ...
research
09/05/2022

Boost Decentralized Federated Learning in Vehicular Networks by Diversifying Data Sources

Recently, federated learning (FL) has received intensive research becaus...

Please sign up or login with your details

Forgot password? Click here to reset