Associative Alignment for Few-shot Image Classification

12/11/2019
by   Arman Afrasiyabi, et al.
0

Few-shot image classification aims at training a model by using only a few (e.g., 5 or even 1) examples of novel classes. The established way of doing so is to rely on a larger set of base data for either pre-training a model, or for training in a meta-learning context. Unfortunately, these approaches often suffer from overfitting since the models can easily memorize all of the novel samples. This paper mitigates this issue and proposes to leverage part of the base data by aligning the novel training instances to the closely related ones in the base training set. This expands the size of the effective novel training set by adding extra related base instances to the few novel ones, thereby allowing to train the entire network. Doing so limits overfitting and simultaneously strengthens the generalization capabilities of the network. We propose two associative alignment strategies: 1) a conditional adversarial alignment loss based on the Wasserstein distance; and 2) a metric-learning loss for minimizing the distance between related base samples and the centroid of novel instances in the feature space. Experiments on two standard datasets demonstrate that combining our centroid-based alignment loss results in absolute accuracy improvements of 4.4 the state of the art for object recognition, fine-grained classification, and cross-domain adaptation, respectively.

READ FULL TEXT
research
06/13/2021

NDPNet: A novel non-linear data projection network for few-shot fine-grained image classification

Metric-based few-shot fine-grained image classification (FSFGIC) aims to...
research
11/24/2020

Persistent Mixture Model Networks for Few-Shot Image Classification

We introduce Persistent Mixture Model (PMM) networks for representation ...
research
10/16/2018

Incremental Few-Shot Learning with Attention Attractor Networks

Machine learning classifiers are often trained to recognize a set of pre...
research
05/04/2020

One-Shot Image Classification by Learning to Restore Prototypes

One-shot image classification aims to train image classifiers over the d...
research
10/24/2021

A Closer Look at Few-Shot Video Classification: A New Baseline and Benchmark

The existing few-shot video classification methods often employ a meta-l...
research
09/27/2022

Stacking Ensemble Learning in Deep Domain Adaptation for Ophthalmic Image Classification

Domain adaptation is an attractive approach given the availability of a ...
research
01/18/2019

Multisource Region Attention Network for Fine-Grained Object Recognition in Remote Sensing Imagery

Fine-grained object recognition concerns the identification of the type ...

Please sign up or login with your details

Forgot password? Click here to reset