A Study on Representation Transfer for Few-Shot Learning

09/05/2022
by   Chun-Nam Yu, et al.
0

Few-shot classification aims to learn to classify new object categories well using only a few labeled examples. Transferring feature representations from other models is a popular approach for solving few-shot classification problems. In this work we perform a systematic study of various feature representations for few-shot classification, including representations learned from MAML, supervised classification, and several common self-supervised tasks. We find that learning from more complex tasks tend to give better representations for few-shot classification, and thus we propose the use of representations learned from multiple tasks for few-shot classification. Coupled with new tricks on feature selection and voting to handle the issue of small sample size, our direct transfer learning method offers performance comparable to state-of-art on several benchmark datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/26/2021

Mutual Contrastive Learning for Visual Representation Learning

We present a collaborative learning method called Mutual Contrastive Lea...
research
10/05/2022

BaseTransformers: Attention over base data-points for One Shot Learning

Few shot classification aims to learn to recognize novel categories usin...
research
07/14/2022

Tree Structure-Aware Few-Shot Image Classification via Hierarchical Aggregation

In this paper, we mainly focus on the problem of how to learn additional...
research
12/30/2021

On the Role of Neural Collapse in Transfer Learning

We study the ability of foundation models to learn representations for c...
research
09/04/2020

GPU-based Self-Organizing Maps for Post-Labeled Few-Shot Unsupervised Learning

Few-shot classification is a challenge in machine learning where the goa...
research
10/06/2020

Representation learning from videos in-the-wild: An object-centric approach

We propose a method to learn image representations from uncurated videos...
research
04/25/2018

Dynamic Few-Shot Visual Learning without Forgetting

The human visual system has the remarkably ability to be able to effortl...

Please sign up or login with your details

Forgot password? Click here to reset