End-to-End Saliency Mapping via Probability Distribution Prediction

04/05/2018
by   Saumya Jetley, et al.
2

Most saliency estimation methods aim to explicitly model low-level conspicuity cues such as edges or blobs and may additionally incorporate top-down cues using face or text detection. Data-driven methods for training saliency models using eye-fixation data are increasingly popular, particularly with the introduction of large-scale datasets and deep architectures. However, current methods in this latter paradigm use loss functions designed for classification or regression tasks whereas saliency estimation is evaluated on topographical maps. In this work, we introduce a new saliency map model which formulates a map as a generalized Bernoulli distribution. We then train a deep architecture to predict such maps using novel loss functions which pair the softmax activation function with measures designed to compute distances between probability distributions. We show in extensive experiments the effectiveness of such loss functions over standard ones on four public benchmark datasets, and demonstrate improved performance over state-of-the-art saliency methods.

READ FULL TEXT

page 1

page 5

page 7

page 8

research
04/07/2019

A Dilated Inception Network for Visual Saliency Prediction

Recently, with the advent of deep convolutional neural networks (DCNN), ...
research
07/04/2019

Deep Saliency Models : The Quest For The Loss Function

Recent advances in deep learning have pushed the performances of visual ...
research
03/10/2020

Tidying Deep Saliency Prediction Architectures

Learning computational models for visual attention (saliency estimation)...
research
12/01/2021

CYBORG: Blending Human Saliency Into the Loss Improves Deep Learning

Can deep learning models achieve greater generalization if their trainin...
research
01/15/2019

Light-weighted Saliency Detection with Distinctively Lower Memory Cost and Model Size

Deep neural networks (DNNs) based saliency detection approaches have suc...
research
08/31/2020

RecSal : Deep Recursive Supervision for Visual Saliency Prediction

State-of-the-art saliency prediction methods develop upon model architec...
research
03/31/2023

Rethinking interpretation: Input-agnostic saliency mapping of deep visual classifiers

Saliency methods provide post-hoc model interpretation by attributing in...

Please sign up or login with your details

Forgot password? Click here to reset