GPU-based Self-Organizing Maps for Post-Labeled Few-Shot Unsupervised Learning

09/04/2020
by   Lyes Khacef, et al.
0

Few-shot classification is a challenge in machine learning where the goal is to train a classifier using a very limited number of labeled examples. This scenario is likely to occur frequently in real life, for example when data acquisition or labeling is expensive. In this work, we consider the problem of post-labeled few-shot unsupervised learning, a classification task where representations are learned in an unsupervised fashion, to be later labeled using very few annotated examples. We argue that this problem is very likely to occur on the edge, when the embedded device directly acquires the data, and the expert needed to perform labeling cannot be prompted often. To address this problem, we consider an algorithm consisting of the concatenation of transfer learning with clustering using Self-Organizing Maps (SOMs). We introduce a TensorFlow-based implementation to speed-up the process in multi-core CPUs and GPUs. Finally, we demonstrate the effectiveness of the method using standard off-the-shelf few-shot classification benchmarks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/20/2019

Unsupervised Few-shot Learning via Self-supervised Training

Learning from limited exemplars (few-shot learning) is a fundamental, un...
research
09/05/2022

A Study on Representation Transfer for Few-Shot Learning

Few-shot classification aims to learn to classify new object categories ...
research
01/29/2022

Few-Shot Transfer Learning for Device-Free Fingerprinting Indoor Localization

Device-free wireless indoor localization is an essential technology for ...
research
08/14/2020

Unsupervised vs. transfer learning for multimodal one-shot matching of speech and images

We consider the task of multimodal one-shot speech-image matching. An ag...
research
10/06/2020

On the Role of Supervision in Unsupervised Constituency Parsing

We analyze several recent unsupervised constituency parsing models, whic...
research
12/30/2021

On the Role of Neural Collapse in Transfer Learning

We study the ability of foundation models to learn representations for c...

Please sign up or login with your details

Forgot password? Click here to reset