Clustered Saliency Prediction

07/05/2022
by   Rezvan Sherkati, et al.
10

We present a new method for image salience prediction, Clustered Saliency Prediction. This method divides individuals into clusters based on their personal features and their known saliency maps, and generates a separate image salience model for each cluster. We test our approach on a public dataset of personalized saliency maps, with varying importance weights for personal feature factors and observe the effects on the clusters. For each cluster, we use an image-to-image translation method, mainly Pix2Pix model, to convert universal saliency maps to saliency maps of that cluster. We try three state-of-the-art universal saliency prediction methods, DeepGaze II, ML-Net and SalGAN, and see their impact on the results. We show that our Clustered Saliency Prediction technique outperforms the state-of-the-art universal saliency prediction models. Also we demonstrate the effectiveness of our clustering method by comparing the results of Clustered Saliency Prediction using clusters obtained by Subject Similarity Clustering algorithm with two baseline methods. We propose an approach to assign new people to the most appropriate cluster, based on their personal features and any known saliency maps. In our experiments we see that this method of assigning new people to a cluster on average chooses the cluster that gives higher saliency scores.

READ FULL TEXT

page 7

page 9

page 11

research
09/05/2016

A Deep Multi-Level Network for Saliency Prediction

This paper presents a novel deep architecture for saliency prediction. C...
research
09/08/2021

Deriving Explanation of Deep Visual Saliency Models

Deep neural networks have shown their profound impact on achieving human...
research
11/21/2017

Personalization of Saliency Estimation

Most existing saliency models use low-level features or task description...
research
08/04/2016

Saliency Integration: An Arbitrator Model

Saliency integration approaches have aroused general concern on unifying...
research
05/24/2023

Reliability Scores from Saliency Map Clusters for Improved Image-based Harvest-Readiness Prediction in Cauliflower

Cauliflower is a hand-harvested crop that must fulfill high-quality stan...
research
05/27/2015

New characterizations of minimum spanning trees and of saliency maps based on quasi-flat zones

We study three representations of hierarchies of partitions: dendrograms...
research
05/04/2021

Canonical Saliency Maps: Decoding Deep Face Models

As Deep Neural Network models for face processing tasks approach human-l...

Please sign up or login with your details

Forgot password? Click here to reset