Federated Semi-Supervised Learning with Inter-Client Consistency

06/22/2020
by   Wonyong Jeong, et al.
14

While existing federated learning approaches mostly require that clients have fully-labeled data to train on, in realistic settings, data obtained at the client side often comes without any accompanying labels. Such deficiency of labels may result from either high labeling cost, or difficulty of annotation due to requirement of expert knowledge. Thus the private data at each client may be only partly labeled, or completely unlabeled with labeled data being available only at the server, which leads us to a new problem of Federated Semi-Supervised Learning (FSSL). In this work, we study this new problem of semi-supervised learning under federated learning framework, and propose a novel method to tackle it, which we refer to as Federated Matching (FedMatch). FedMatch improves upon naive federated semi-supervised learning approaches with a new inter-client consistency loss and decomposition of the parameters into parameters for labeled and unlabeled data. Through extensive experimental validation of our method in two different scenarios, we show that our method outperforms both local semi-supervised learning and baselines which naively combine federated learning with semi-supervised learning.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/12/2021

FedTriNet: A Pseudo Labeling Method with Three Players for Federated Semi-supervised Learning

Federated Learning has shown great potentials for the distributed data u...
research
07/11/2023

Combating Data Imbalances in Federated Semi-supervised Learning with Dual Regulators

Federated learning has become a popular method to learn from decentraliz...
research
03/04/2023

Federated Semi-Supervised Learning with Annotation Heterogeneity

Federated Semi-Supervised Learning (FSSL) aims to learn a global model f...
research
06/16/2021

Federated Semi-supervised Medical Image Classification via Inter-client Relation Matching

Federated learning (FL) has emerged with increasing popularity to collab...
research
02/26/2020

A Survey towards Federated Semi-supervised Learning

The success of Artificial Intelligence (AI) should be largely attributed...
research
08/26/2020

Benchmarking Semi-supervised Federated Learning

Federated learning promises to use the computational power of edge devic...
research
07/08/2021

A Federated Semi-Supervised Learning Approach for Network Traffic Classification

Network traffic classification, a task to classify network traffic and i...

Please sign up or login with your details

Forgot password? Click here to reset