Federated Semi-Supervised Learning with Annotation Heterogeneity

03/04/2023
by   Xinyi Shang, et al.
0

Federated Semi-Supervised Learning (FSSL) aims to learn a global model from different clients in an environment with both labeled and unlabeled data. Most of the existing FSSL work generally assumes that both types of data are available on each client. In this paper, we study a more general problem setup of FSSL with annotation heterogeneity, where each client can hold an arbitrary percentage (0 framework called Heterogeneously Annotated Semi-Supervised LEarning (HASSLE). Specifically, it is a dual-model framework with two models trained separately on labeled and unlabeled data such that it can be simply applied to a client with an arbitrary labeling percentage. Furthermore, a mutual learning strategy called Supervised-Unsupervised Mutual Alignment (SUMA) is proposed for the dual models within HASSLE with global residual alignment and model proximity alignment. Subsequently, the dual models can implicitly learn from both types of data across different clients, although each dual model is only trained locally on a single type of data. Experiments verify that the dual models in HASSLE learned by SUMA can mutually learn from each other, thereby effectively utilizing the information of both types of data across different clients.

READ FULL TEXT

page 1

page 2

page 8

page 12

page 13

research
06/22/2020

Federated Semi-Supervised Learning with Inter-Client Consistency

While existing federated learning approaches mostly require that clients...
research
07/11/2023

Combating Data Imbalances in Federated Semi-supervised Learning with Dual Regulators

Federated learning has become a popular method to learn from decentraliz...
research
11/16/2022

Dual Class-Aware Contrastive Federated Semi-Supervised Learning

Federated semi-supervised learning (FSSL), facilitates labeled clients a...
research
09/09/2021

FedCon: A Contrastive Framework for Federated Semi-Supervised Learning

Federated Semi-Supervised Learning (FedSSL) has gained rising attention ...
research
10/29/2021

Federated Semi-Supervised Learning with Class Distribution Mismatch

Many existing federated learning (FL) algorithms are designed for superv...
research
05/01/2023

Towards Unbiased Training in Federated Open-world Semi-supervised Learning

Federated Semi-supervised Learning (FedSSL) has emerged as a new paradig...
research
01/11/2023

Dual Learning for Large Vocabulary On-Device ASR

Dual learning is a paradigm for semi-supervised machine learning that se...

Please sign up or login with your details

Forgot password? Click here to reset