Few-shot Classification via Adaptive Attention

08/06/2020
by   Zihang Jiang, et al.
0

Training a neural network model that can quickly adapt to a new task is highly desirable yet challenging for few-shot learning problems. Recent few-shot learning methods mostly concentrate on developing various meta-learning strategies from two aspects, namely optimizing an initial model or learning a distance metric. In this work, we propose a novel few-shot learning method via optimizing and fast adapting the query sample representation based on very few reference samples. To be specific, we devise a simple and efficient meta-reweighting strategy to adapt the sample representations and generate soft attention to refine the representation such that the relevant features from the query and support samples can be extracted for a better few-shot classification. Such an adaptive attention model is also able to explain what the classification model is looking for as the evidence for classification to some extent. As demonstrated experimentally, the proposed model achieves state-of-the-art classification results on various benchmark few-shot classification and fine-grained recognition datasets.

READ FULL TEXT
research
05/23/2019

Meta-GNN: On Few-shot Node Classification in Graph Meta-learning

Meta-learning has received a tremendous recent attention as a possible a...
research
05/16/2019

TapNet: Neural Network Augmented with Task-Adaptive Projection for Few-Shot Learning

Handling previously unseen tasks after given only a few training example...
research
11/01/2021

Influential Prototypical Networks for Few Shot Learning: A Dermatological Case Study

Prototypical network (PN) is a simple yet effective few shot learning st...
research
08/19/2022

IPNET:Influential Prototypical Networks for Few Shot Learning

Prototypical network (PN) is a simple yet effective few shot learning st...
research
03/25/2021

Learning Dynamic Alignment via Meta-filter for Few-shot Learning

Few-shot learning (FSL), which aims to recognise new classes by adapting...
research
03/19/2020

XtarNet: Learning to Extract Task-Adaptive Representation for Incremental Few-Shot Learning

Learning novel concepts while preserving prior knowledge is a long-stand...
research
03/25/2022

CAD: Co-Adapting Discriminative Features for Improved Few-Shot Classification

Few-shot classification is a challenging problem that aims to learn a mo...

Please sign up or login with your details

Forgot password? Click here to reset