Mask guided attention for fine-grained patchy image classification

02/04/2021
by   Jun Wang, et al.
10

In this work, we present a novel mask guided attention (MGA) method for fine-grained patchy image classification. The key challenge of fine-grained patchy image classification lies in two folds, ultra-fine-grained inter-category variances among objects and very few data available for training. This motivates us to consider employing more useful supervision signal to train a discriminative model within limited training samples. Specifically, the proposed MGA integrates a pre-trained semantic segmentation model that produces auxiliary supervision signal, i.e., patchy attention mask, enabling a discriminative representation learning. The patchy attention mask drives the classifier to filter out the insignificant parts of images (e.g., common features between different categories), which enhances the robustness of MGA for the fine-grained patchy image classification. We verify the effectiveness of our method on three publicly available patchy image datasets. Experimental results demonstrate that our MGA method achieves superior performance on three datasets compared with the state-of-the-art methods. In addition, our ablation study shows that MGA improves the accuracy by 2.25 2 towards solving the fine-grained patchy image classification.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

11/24/2014

The Application of Two-level Attention Models in Deep Convolutional Neural Network for Fine-grained Image Classification

Fine-grained classification is challenging because categories can only b...
04/10/2017

Fine-graind Image Classification via Combining Vision and Language

Fine-grained image classification is a challenging task due to the large...
09/16/2021

Mask-Guided Feature Extraction and Augmentation for Ultra-Fine-Grained Visual Categorization

While the fine-grained visual categorization (FGVC) problems have been g...
06/28/2021

Progressive Class-based Expansion Learning For Image Classification

In this paper, we propose a novel image process scheme called class-base...
09/25/2021

A Compositional Feature Embedding and Similarity Metric for Ultra-Fine-Grained Visual Categorization

Fine-grained visual categorization (FGVC), which aims at classifying obj...
11/27/2018

Generating Attention from Classifier Activations for Fine-grained Recognition

Recent advances in fine-grained recognition utilize attention maps to lo...
05/21/2020

Interpretable and Accurate Fine-grained Recognition via Region Grouping

We present an interpretable deep model for fine-grained visual recogniti...

Code Repositories

Mask-Guided-Attention-for-Fine-grained-Patchy-Image-Classification

MASK GUIDED ATTENTION FOR FINE-GRAINED PATCHY IMAGE CLASSIFICATION


view repo
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.