Federated Learning from Only Unlabeled Data with Class-Conditional-Sharing Clients

04/07/2022
by   Nan Lu, et al.
25

Supervised federated learning (FL) enables multiple clients to share the trained model without sharing their labeled data. However, potential clients might even be reluctant to label their own data, which could limit the applicability of FL in practice. In this paper, we show the possibility of unsupervised FL whose model is still a classifier for predicting class labels, if the class-prior probabilities are shifted while the class-conditional distributions are shared among the unlabeled data owned by the clients. We propose federation of unsupervised learning (FedUL), where the unlabeled data are transformed into surrogate labeled data for each of the clients, a modified model is trained by supervised FL, and the wanted model is recovered from the modified model. FedUL is a very general solution to unsupervised FL: it is compatible with many supervised FL methods, and the recovery of the wanted model can be theoretically guaranteed as if the data have been labeled. Experiments on benchmark and real-world datasets demonstrate the effectiveness of FedUL. Code is available at https://github.com/lunanbit/FedUL.

READ FULL TEXT
research
10/15/2021

FedSEAL: Semi-Supervised Federated Learning with Self-Ensemble Learning and Negative Learning

Federated learning (FL), a popular decentralized and privacy-preserving ...
research
07/17/2023

Local or Global: Selective Knowledge Assimilation for Federated Learning with Limited Labels

Many existing FL methods assume clients with fully-labeled data, while i...
research
02/23/2023

FedIL: Federated Incremental Learning from Decentralized Unlabeled Data with Convergence Analysis

Most existing federated learning methods assume that clients have fully ...
research
09/09/2022

Anomaly Detection through Unsupervised Federated Learning

Federated learning (FL) is proving to be one of the most promising parad...
research
12/08/2020

RC-SSFL: Towards Robust and Communication-efficient Semi-supervised Federated Learning System

Federated Learning (FL) is an emerging decentralized artificial intellig...
research
01/28/2023

Does Federated Learning Really Need Backpropagation?

Federated learning (FL) is a general principle for decentralized clients...
research
03/03/2022

Vertical Federated Principal Component Analysis and Its Kernel Extension on Feature-wise Distributed Data

Despite enormous research interest and rapid application of federated le...

Please sign up or login with your details

Forgot password? Click here to reset