Real Time Image Saliency for Black Box Classifiers

05/22/2017
by   Piotr Dabkowski, et al.
0

In this work we develop a fast saliency detection method that can be applied to any differentiable image classifier. We train a masking model to manipulate the scores of the classifier by masking salient parts of the input image. Our model generalises well to unseen images and requires a single forward pass to perform saliency detection, therefore suitable for use in real-time systems. We test our approach on CIFAR-10 and ImageNet datasets and show that the produced saliency maps are easily interpretable, sharp, and free of artifacts. We suggest a new metric for saliency and test our method on the ImageNet object localisation task. We achieve results outperforming other weakly supervised methods.

READ FULL TEXT

page 2

page 3

page 4

page 7

page 9

page 13

page 14

page 15

research
11/16/2016

Weakly Supervised Top-down Salient Object Detection

Top-down saliency models produce a probability map that peaks at target ...
research
01/04/2021

Weakly-Supervised Saliency Detection via Salient Object Subitizing

Salient object detection aims at detecting the most visually distinct ob...
research
05/23/2022

What You See is What You Classify: Black Box Attributions

An important step towards explaining deep image classifiers lies in the ...
research
12/16/2022

Robust Saliency Guidance for Data-free Class Incremental Learning

Data-Free Class Incremental Learning (DFCIL) aims to sequentially learn ...
research
05/24/2023

Reliability Scores from Saliency Map Clusters for Improved Image-based Harvest-Readiness Prediction in Cauliflower

Cauliflower is a hand-harvested crop that must fulfill high-quality stan...
research
09/26/2022

Ablation Path Saliency

Various types of saliency methods have been proposed for explaining blac...
research
12/31/2020

iGOS++: Integrated Gradient Optimized Saliency by Bilateral Perturbations

The black-box nature of the deep networks makes the explanation for "why...

Please sign up or login with your details

Forgot password? Click here to reset