Rethinking Clustering-Based Pseudo-Labeling for Unsupervised Meta-Learning

09/27/2022
by   Xingping Dong, et al.
0

The pioneering method for unsupervised meta-learning, CACTUs, is a clustering-based approach with pseudo-labeling. This approach is model-agnostic and can be combined with supervised algorithms to learn from unlabeled data. However, it often suffers from label inconsistency or limited diversity, which leads to poor performance. In this work, we prove that the core reason for this is lack of a clustering-friendly property in the embedding space. We address this by minimizing the inter- to intra-class similarity ratio to provide clustering-friendly embedding features, and validate our approach through comprehensive experiments. Note that, despite only utilizing a simple clustering algorithm (k-means) in our embedding space to obtain the pseudo-labels, we achieve significant improvement. Moreover, we adopt a progressive evaluation mechanism to obtain more diverse samples in order to further alleviate the limited diversity problem. Finally, our approach is also model-agnostic and can easily be integrated into existing supervised methods. To demonstrate its generalization ability, we integrate it into two representative algorithms: MAML and EP. The results on three main few-shot benchmarks clearly show that the proposed method achieves significant improvement compared to state-of-the-art models. Notably, our approach also outperforms the corresponding supervised method in two tasks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/02/2023

Unsupervised Meta-Learning via Few-shot Pseudo-supervised Contrastive Learning

Unsupervised meta-learning aims to learn generalizable knowledge across ...
research
03/17/2021

SPICE: Semantic Pseudo-labeling for Image Clustering

This paper presents SPICE, a Semantic Pseudo-labeling framework for Imag...
research
04/21/2023

Task-Adaptive Pseudo Labeling for Transductive Meta-Learning

Meta-learning performs adaptation through a limited amount of support se...
research
05/04/2022

Self-Taught Metric Learning without Labels

We present a novel self-taught framework for unsupervised metric learnin...
research
11/19/2021

Meta Clustering Learning for Large-scale Unsupervised Person Re-identification

Unsupervised Person Re-identification (U-ReID) with pseudo labeling rece...
research
05/22/2023

Progressive Sub-Graph Clustering Algorithm for Semi-Supervised Domain Adaptation Speaker Verification

Utilizing the large-scale unlabeled data from the target domain via pseu...
research
08/06/2021

Unsupervised Learning of Debiased Representations with Pseudo-Attributes

Dataset bias is a critical challenge in machine learning, and its negati...

Please sign up or login with your details

Forgot password? Click here to reset