Prototype Rectification for Few-Shot Learning

11/25/2019
by   Jinlu Liu, et al.
0

Few-shot learning is a challenging problem that requires a model to recognize novel classes with few labeled data. In this paper, we aim to find the expected prototypes of the novel classes, which have the maximum cosine similarity with the samples of the same class. Firstly, we propose a cosine similarity based prototypical network to compute basic prototypes of the novel classes from the few samples. A bias diminishing module is further proposed for prototype rectification since the basic prototypes computed in the low-data regime are biased against the expected prototypes. In our method, the intra-class bias and the cross-class bias are diminished to modify the prototypes. Then we give a theoretical analysis of the impact of the bias diminishing module on the expected performance of our method. We conduct extensive experiments on four few-shot benchmarks and further analyze the advantage of the bias diminishing module. The bias diminishing module brings in significant improvement by a large margin of 3 state-of-the-art performance on miniImageNet (70.31 5-shot) and tieredImageNet (78.74 demonstrates the superiority of the proposed method.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/01/2021

Few-shot learning with improved local representations via bias rectify module

Recent approaches based on metric learning have achieved great progress ...
research
08/25/2021

Learning Class-level Prototypes for Few-shot Learning

Few-shot learning aims to recognize new categories using very few labele...
research
03/26/2021

MetaNODE: Prototype Optimization as a Neural ODE for Few-Shot Learning

Few-Shot Learning (FSL) is a challenging task, i.e., how to recognize no...
research
10/17/2019

Cross Attention Network for Few-shot Classification

Few-shot classification aims to recognize unlabeled samples from unseen ...
research
03/31/2023

What Makes for Effective Few-shot Point Cloud Classification?

Due to the emergence of powerful computing resources and large-scale ann...
research
04/07/2022

Powering Finetuning in Few-shot Learning: Domain-Agnostic Feature Adaptation with Rectified Class Prototypes

In recent works, utilizing a deep network trained on meta-training set s...
research
10/06/2021

On the Importance of Firth Bias Reduction in Few-Shot Classification

Learning accurate classifiers for novel categories from very few example...

Please sign up or login with your details

Forgot password? Click here to reset