Federated Momentum Contrastive Clustering

06/10/2022
by   Runxuan Miao, et al.
0

We present federated momentum contrastive clustering (FedMCC), a learning framework that can not only extract discriminative representations over distributed local data but also perform data clustering. In FedMCC, a transformed data pair passes through both the online and target networks, resulting in four representations over which the losses are determined. The resulting high-quality representations generated by FedMCC can outperform several existing self-supervised learning methods for linear evaluation and semi-supervised learning tasks. FedMCC can easily be adapted to ordinary centralized clustering through what we call momentum contrastive clustering (MCC). We show that MCC achieves state-of-the-art clustering accuracy results in certain datasets such as STL-10 and ImageNet-10. We also present a method to reduce the memory footprint of our clustering schemes.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/13/2020

A Simple Framework for Contrastive Learning of Visual Representations

This paper presents SimCLR: a simple framework for contrastive learning ...
research
12/13/2020

Self-supervised Text-independent Speaker Verification using Prototypical Momentum Contrastive Learning

In this study, we investigate self-supervised representation learning fo...
research
07/13/2022

Unsupervised Visual Representation Learning by Synchronous Momentum Grouping

In this paper, we propose a genuine group-level contrastive visual repre...
research
08/01/2019

Contrastive Reasons Detection and Clustering from Online Polarized Debate

This work tackles the problem of unsupervised modeling and extraction of...
research
04/18/2021

Solving Inefficiency of Self-supervised Representation Learning

Self-supervised learning has attracted great interest due to its tremend...
research
04/05/2020

Clustering based Contrastive Learning for Improving Face Representations

A good clustering algorithm can discover natural groupings in data. Thes...
research
05/17/2023

Exploring Inductive Biases in Contrastive Learning: A Clustering Perspective

This paper investigates the differences in data organization between con...

Please sign up or login with your details

Forgot password? Click here to reset