FedCon: A Contrastive Framework for Federated Semi-Supervised Learning

09/09/2021
by   Zewei Long, et al.
19

Federated Semi-Supervised Learning (FedSSL) has gained rising attention from both academic and industrial researchers, due to its unique characteristics of co-training machine learning models with isolated yet unlabeled data. Most existing FedSSL methods focus on the classical scenario, i.e, the labeled and unlabeled data are stored at the client side. However, in real world applications, client users may not provide labels without any incentive. Thus, the scenario of labels at the server side is more practical. Since unlabeled data and labeled data are decoupled, most existing FedSSL approaches may fail to deal with such a scenario. To overcome this problem, in this paper, we propose FedCon, which introduces a new learning paradigm, i.e., contractive learning, to FedSSL. Experimental results on three datasets show that FedCon achieves the best performance with the contractive framework compared with state-of-the-art baselines under both IID and Non-IID settings. Besides, ablation studies demonstrate the characteristics of the proposed FedCon framework.

READ FULL TEXT
research
09/12/2021

FedTriNet: A Pseudo Labeling Method with Three Players for Federated Semi-supervised Learning

Federated Learning has shown great potentials for the distributed data u...
research
12/06/2020

FedSemi: An Adaptive Federated Semi-Supervised Learning Framework

Federated learning (FL) has emerged as an effective technique to co-trai...
research
07/11/2023

Combating Data Imbalances in Federated Semi-supervised Learning with Dual Regulators

Federated learning has become a popular method to learn from decentraliz...
research
05/25/2019

Semi-supervised Learning with Contrastive Predicative Coding

Semi-supervised learning (SSL) provides a powerful framework for leverag...
research
06/14/2021

RETRIEVE: Coreset Selection for Efficient and Robust Semi-Supervised Learning

Semi-supervised learning (SSL) algorithms have had great success in rece...
research
01/13/2019

Gradient Regularized Budgeted Boosting

As machine learning transitions increasingly towards real world applicat...
research
03/04/2023

Federated Semi-Supervised Learning with Annotation Heterogeneity

Federated Semi-Supervised Learning (FSSL) aims to learn a global model f...

Please sign up or login with your details

Forgot password? Click here to reset