You Never Cluster Alone

06/03/2021
by   Yuming Shen, et al.
0

Recent advances in self-supervised learning with instance-level contrastive objectives facilitate unsupervised clustering. However, a standalone datum is not perceiving the context of the holistic cluster, and may undergo sub-optimal assignment. In this paper, we extend the mainstream contrastive learning paradigm to a cluster-level scheme, where all the data subjected to the same cluster contribute to a unified representation that encodes the context of each data group. Contrastive learning with this representation then rewards the assignment of each datum. To implement this vision, we propose twin-contrast clustering (TCC). We define a set of categorical variables as clustering assignment confidence, which links the instance-level learning track with the cluster-level one. On one hand, with the corresponding assignment variables being the weight, a weighted aggregation along the data points implements the set representation of a cluster. We further propose heuristic cluster augmentation equivalents to enable cluster-level contrastive learning. On the other hand, we derive the evidence lower-bound of the instance-level contrastive objective with the assignments. By reparametrizing the assignment variables, TCC is trained end-to-end, requiring no alternating steps. Extensive experiments show that TCC outperforms the state-of-the-art on challenging benchmarks.

READ FULL TEXT

page 1

page 2

page 3

page 4

07/08/2022

Few-Example Clustering via Contrastive Learning

We propose Few-Example Clustering (FEC), a novel algorithm that performs...
04/03/2021

Graph Contrastive Clustering

Recently, some contrastive learning methods have been proposed to simult...
09/21/2020

Contrastive Clustering

In this paper, we propose a one-stage online clustering method called Co...
04/21/2022

Adversarial Contrastive Learning by Permuting Cluster Assignments

Contrastive learning has gained popularity as an effective self-supervis...
11/15/2021

Large-Scale Hyperspectral Image Clustering Using Contrastive Learning

Clustering of hyperspectral images is a fundamental but challenging task...
09/27/2021

Click-through Rate Prediction with Auto-Quantized Contrastive Learning

Click-through rate (CTR) prediction becomes indispensable in ubiquitous ...
08/04/2020

LoCo: Local Contrastive Representation Learning

Deep neural nets typically perform end-to-end backpropagation to learn t...