Saliency Integration: An Arbitrator Model

08/04/2016
by   Yingyue Xu, et al.
0

Saliency integration approaches have aroused general concern on unifying saliency maps from multiple saliency models. In fact, saliency integration is a weighted aggregation of multiple saliency maps, such that measuring the weights of saliency models is essential. In this paper, we propose an unsupervised model for saliency integration, namely the arbitrator model (AM), based on the Bayes' probability theory. The proposed AM incorporates saliency models of varying expertise and a prior map based on the consistency of the evidence from multiple saliency models and a reference saliency map from generally accepted knowledge. Also, we suggest two methods to learn the expertise of the saliency models without ground truth. The experimental results are from various combinations of twenty-two state-of-the-art saliency models on five datasets. The evaluation results show that the AM model improves the performance substantially compared to the existing state-of-the-art approaches, regardless of the chosen candidate saliency models.

READ FULL TEXT

page 3

page 8

research
05/31/2016

Quantitative Analysis of Saliency Models

Previous saliency detection research required the reader to evaluate per...
research
09/03/2018

Learning Saliency Prediction From Sparse Fixation Pixel Map

Ground truth for saliency prediction datasets consists of two types of m...
research
05/21/2018

Classifier-agnostic saliency map extraction

We argue for the importance of decoupling saliency map extraction from a...
research
05/13/2021

Sanity Simulations for Saliency Methods

Saliency methods are a popular class of feature attribution tools that a...
research
12/09/2021

Evaluating saliency methods on artificial data with different background types

Over the last years, many 'explainable artificial intelligence' (xAI) ap...
research
10/27/2021

Revisiting Sanity Checks for Saliency Maps

Saliency methods are a popular approach for model debugging and explaina...
research
07/05/2022

Clustered Saliency Prediction

We present a new method for image salience prediction, Clustered Salienc...

Please sign up or login with your details

Forgot password? Click here to reset