Boosting Few-shot Fine-grained Recognition with Background Suppression and Foreground Alignment

10/04/2022
by   Zican Zha, et al.
0

Few-shot fine-grained recognition (FS-FGR) aims to recognize novel fine-grained categories with the help of limited available samples. Undoubtedly, this task inherits the main challenges from both few-shot learning and fine-grained recognition. First, the lack of labeled samples makes the learned model easy to overfit. Second, it also suffers from high intra-class variance and low inter-class difference in the datasets. To address this challenging task, we propose a two-stage background suppression and foreground alignment framework, which is composed of a background activation suppression (BAS) module, a foreground object alignment (FOA) module, and a local to local (L2L) similarity metric. Specifically, the BAS is introduced to generate a foreground mask for localization to weaken background disturbance and enhance dominative foreground objects. What's more, considering the lack of labeled samples, we compute the pairwise similarity of feature maps using both the raw image and the refined image. The FOA then reconstructs the feature map of each support sample according to its correction to the query ones, which addresses the problem of misalignment between support-query image pairs. To enable the proposed method to have the ability to capture subtle differences in confused samples, we present a novel L2L similarity metric to further measure the local similarity between a pair of aligned spatial features in the embedding space. Extensive experiments conducted on multiple popular fine-grained benchmarks demonstrate that our method outperforms the existing state-of-the-art by a large margin.

READ FULL TEXT

page 1

page 2

page 5

page 12

page 13

research
08/30/2021

Object-aware Long-short-range Spatial Alignment for Few-Shot Fine-Grained Image Classification

The goal of few-shot fine-grained image classification is to recognize r...
research
05/28/2020

TOAN: Target-Oriented Alignment Network for Fine-Grained Image Categorization with Few Labeled Samples

The challenges of high intra-class variance yet low inter-class fluctuat...
research
03/11/2023

Fine-grained Visual Classification with High-temperature Refinement and Background Suppression

Fine-grained visual classification is a challenging task due to the high...
research
11/29/2020

BSNet: Bi-Similarity Network for Few-shot Fine-grained Image Classification

Few-shot learning for fine-grained image classification has gained recen...
research
09/10/2020

Attributes-Guided and Pure-Visual Attention Alignment for Few-Shot Recognition

The purpose of few-shot recognition is to recognize novel categories wit...
research
09/19/2020

Weak-shot Fine-grained Classification via Similarity Transfer

Recognizing fine-grained categories remains a challenging task, due to t...
research
07/22/2019

Quadruplet Selection Methods for Deep Embedding Learning

Recognition of objects with subtle differences has been used in many pra...

Please sign up or login with your details

Forgot password? Click here to reset