SESS: Saliency Enhancing with Scaling and Sliding

07/05/2022
by   Osman Tursun, et al.
7

High-quality saliency maps are essential in several machine learning application areas including explainable AI and weakly supervised object detection and segmentation. Many techniques have been developed to generate better saliency using neural networks. However, they are often limited to specific saliency visualisation methods or saliency issues. We propose a novel saliency enhancing approach called SESS (Saliency Enhancing with Scaling and Sliding). It is a method and model agnostic extension to existing saliency map generation methods. With SESS, existing saliency approaches become robust to scale variance, multiple occurrences of target objects, presence of distractors and generate less noisy and more discriminative saliency maps. SESS improves saliency by fusing saliency maps extracted from multiple patches at different scales from different areas, and combines these individual maps using a novel fusion scheme that incorporates channel-wise weights and spatial weighted average. To improve efficiency, we introduce a pre-filtering step that can exclude uninformative saliency maps to improve efficiency while still enhancing overall results. We evaluate SESS on object recognition and detection benchmarks where it achieves significant improvement. The code is released publicly to enable researchers to verify performance and further development. Code is available at: https://github.com/neouyghur/SESS

READ FULL TEXT

page 2

page 6

page 8

page 9

page 11

page 13

page 17

page 18

research
03/09/2022

3SD: Self-Supervised Saliency Detection With No Labels

We present a conceptually simple self-supervised method for saliency det...
research
01/11/2023

TinyHD: Efficient Video Saliency Prediction with Heterogeneous Decoders using Hierarchical Maps Distillation

Video saliency prediction has recently attracted attention of the resear...
research
01/21/2022

Conceptor Learning for Class Activation Mapping

Class Activation Mapping (CAM) has been widely adopted to generate salie...
research
03/25/2021

Group-CAM: Group Score-Weighted Visual Explanations for Deep Convolutional Networks

In this paper, we propose an efficient saliency map generation method, c...
research
10/01/2021

Summarize and Search: Learning Consensus-aware Dynamic Convolution for Co-Saliency Detection

Humans perform co-saliency detection by first summarizing the consensus ...
research
12/09/2022

Expeditious Saliency-guided Mix-up through Random Gradient Thresholding

Mix-up training approaches have proven to be effective in improving the ...
research
10/01/2019

Research on insect pest image detection and recognition based on bio-inspired methods

Insect pest recognition is necessary for crop protection in many areas o...

Please sign up or login with your details

Forgot password? Click here to reset