SimpleShot: Revisiting Nearest-Neighbor Classification for Few-Shot Learning

11/12/2019
by   Yan Wang, et al.
0

Few-shot learners aim to recognize new object classes based on a small number of labeled training examples. To prevent overfitting, state-of-the-art few-shot learners use meta-learning on convolutional-network features and perform classification using a nearest-neighbor classifier. This paper studies the accuracy of nearest-neighbor baselines without meta-learning. Surprisingly, we find simple feature transformations suffice to obtain competitive few-shot learning accuracies. For example, we find that a nearest-neighbor classifier used in combination with mean-subtraction and L2-normalization outperforms prior results in three out of five settings on the miniImageNet dataset.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/07/2020

Distributionally Robust k-Nearest Neighbors for Few-Shot Learning

Learning a robust classifier from a few samples remains a key challenge ...
research
04/07/2019

Meta-Learning with Differentiable Convex Optimization

Many meta-learning approaches for few-shot learning rely on simple base ...
research
12/05/2022

Improving Few-Shot Performance of Language Models via Nearest Neighbor Calibration

Pre-trained language models (PLMs) have exhibited remarkable few-shot le...
research
03/28/2019

Revisiting Local Descriptor based Image-to-Class Measure for Few-shot Learning

Few-shot learning in image classification aims to learn a classifier to ...
research
10/25/2020

Discriminative Nearest Neighbor Few-Shot Intent Detection by Transferring Natural Language Inference

Intent detection is one of the core components of goal-oriented dialog s...
research
12/19/2017

Learning with Imprinted Weights

Human vision is able to immediately recognize novel visual categories af...
research
06/29/2023

Understanding the Overfitting of the Episodic Meta-training

Despite the success of two-stage few-shot classification methods, in the...

Please sign up or login with your details

Forgot password? Click here to reset