Embedding Adaptation is Still Needed for Few-Shot Learning

04/15/2021
by   Sébastien M. R. Arnold, et al.
0

Constructing new and more challenging tasksets is a fruitful methodology to analyse and understand few-shot classification methods. Unfortunately, existing approaches to building those tasksets are somewhat unsatisfactory: they either assume train and test task distributions to be identical – which leads to overly optimistic evaluations – or take a "worst-case" philosophy – which typically requires additional human labor such as obtaining semantic class relationships. We propose ATG, a principled clustering method to defining train and test tasksets without additional human knowledge. ATG models train and test task distributions while requiring them to share a predefined amount of information. We empirically demonstrate the effectiveness of ATG in generating tasksets that are easier, in-between, or harder than existing benchmarks, including those that rely on semantic information. Finally, we leverage our generated tasksets to shed a new light on few-shot classification: gradient-based methods – previously believed to underperform – can outperform metric-based ones when transfer is most challenging.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/12/2022

Semantic Cross Attention for Few-shot Learning

Few-shot learning (FSL) has attracted considerable attention recently. A...
research
06/18/2019

Fast and Flexible Multi-Task Classification Using Conditional Neural Adaptive Processes

The goal of this paper is to design image classification systems that, a...
research
12/16/2021

Semantic-Based Few-Shot Learning by Interactive Psychometric Testing

Few-shot classification tasks aim to classify images in query sets based...
research
10/18/2021

Squeezing Backbone Feature Distributions to the Max for Efficient Few-Shot Learning

Few-shot classification is a challenging problem due to the uncertainty ...
research
06/05/2019

Baby steps towards few-shot learning with multiple semantics

Learning from one or few visual examples is one of the key capabilities ...
research
07/07/2022

Diagnosing and Remedying Shot Sensitivity with Cosine Few-Shot Learners

Few-shot recognition involves training an image classifier to distinguis...
research
11/06/2020

Leveraging an Efficient and Semantic Location Embedding to Seek New Ports of Bike Share Services

For short distance traveling in crowded urban areas, bike share services...

Please sign up or login with your details

Forgot password? Click here to reset