Revisiting Deep Local Descriptor for Improved Few-Shot Classification

03/30/2021
by   Jun He, et al.
1

Few-shot classification studies the problem of quickly adapting a deep learner to understanding novel classes based on few support images. In this context, recent research efforts have been aimed at designing more and more complex classifiers that measure similarities between query and support images, but left the importance of feature embeddings seldom explored. We show that the reliance on sophisticated classifier is not necessary and a simple classifier applied directly to improved feature embeddings can outperform state-of-the-art methods. To this end, we present a new method named DCAP in which we investigate how one can improve the quality of embeddings by leveraging Dense Classification and Attentive Pooling. Specifically, we propose to pre-train a learner on base classes with abundant samples to solve dense classification problem first and then fine-tune the learner on a bunch of randomly sampled few-shot tasks to adapt it to few-shot scenerio or the test time scenerio. We suggest to pool feature maps by applying attentive pooling instead of the widely used global average pooling (GAP) to prepare embeddings for few-shot classification during meta-finetuning. Attentive pooling learns to reweight local descriptors, explaining what the learner is looking for as evidence for decision making. Experiments on two benchmark datasets show the proposed method to be superior in multiple few-shot settings while being simpler and more explainable. Code is available at: <https://github.com/Ukeyboard/dcap/>.

READ FULL TEXT

page 1

page 2

page 11

research
03/28/2019

Revisiting Local Descriptor based Image-to-Class Measure for Few-shot Learning

Few-shot learning in image classification aims to learn a classifier to ...
research
12/03/2020

Meta-Generating Deep Attentive Metric for Few-shot Classification

Learning to generate a task-aware base learner proves a promising direct...
research
10/05/2022

BaseTransformers: Attention over base data-points for One Shot Learning

Few shot classification aims to learn to recognize novel categories usin...
research
07/12/2021

Few-shot Learning with Global Relatedness Decoupled-Distillation

Despite the success that metric learning based approaches have achieved ...
research
03/25/2022

CAD: Co-Adapting Discriminative Features for Improved Few-Shot Classification

Few-shot classification is a challenging problem that aims to learn a mo...
research
11/04/2022

Elimination of Non-Novel Segments at Multi-Scale for Few-Shot Segmentation

Few-shot segmentation aims to devise a generalizing model that segments ...

Please sign up or login with your details

Forgot password? Click here to reset