Hallucinating Saliency Maps for Fine-Grained Image Classification for Limited Data Domains

07/24/2020
by   Carola Figueroa Flores, et al.
0

Most of the saliency methods are evaluated on their ability to generate saliency maps, and not on their functionality in a complete vision pipeline, like for instance, image classification. In the current paper, we propose an approach which does not require explicit saliency maps to improve image classification, but they are learned implicitely, during the training of an end-to-end image classification task. We show that our approach obtains similar results as the case when the saliency maps are provided explicitely. Combining RGB data with saliency maps represents a significant advantage for object recognition, especially for the case when training data is limited. We validate our method on several datasets for fine-grained classification tasks (Flowers, Birds and Cars). In addition, we show that our saliency estimation method, which is trained without any saliency groundtruth data, obtains competitive results on real image saliency benchmark (Toronto), and outperforms deep saliency models with synthetic images (SID4VAM).

READ FULL TEXT

page 3

page 7

research
08/01/2018

Saliency for Fine-grained Object Recognition in Domains with Scarce Training Data

This paper investigates the role of saliency to improve the classificati...
research
07/20/2021

Saliency for free: Saliency prediction as a side-effect of object recognition

Saliency is the perceptual capacity of our visual system to focus our at...
research
09/20/2023

COSE: A Consistency-Sensitivity Metric for Saliency on Image Classification

We present a set of metrics that utilize vision priors to effectively as...
research
07/27/2018

Influence of Image Classification Accuracy on Saliency Map Estimation

Saliency map estimation in computer vision aims to estimate the location...
research
09/15/2017

Top-Down Saliency Detection Driven by Visual Classification

This paper presents an approach for top-down saliency detection guided b...
research
06/30/2020

ITSELF: Iterative Saliency Estimation fLexible Framework

Saliency object detection estimates the objects that most stand out in a...
research
09/10/2018

Learning to Zoom: a Saliency-Based Sampling Layer for Neural Networks

We introduce a saliency-based distortion layer for convolutional neural ...

Please sign up or login with your details

Forgot password? Click here to reset