Do Saliency Models Detect Odd-One-Out Targets? New Datasets and Evaluations

by   Iuliia Kotseruba, et al.

Recent advances in the field of saliency have concentrated on fixation prediction, with benchmarks reaching saturation. However, there is an extensive body of works in psychology and neuroscience that describe aspects of human visual attention that might not be adequately captured by current approaches. Here, we investigate singleton detection, which can be thought of as a canonical example of salience. We introduce two novel datasets, one with psychophysical patterns and one with natural odd-one-out stimuli. Using these datasets we demonstrate through extensive experimentation that nearly all saliency algorithms do not adequately respond to singleton targets in synthetic and natural images. Furthermore, we investigate the effect of training state-of-the-art CNN-based saliency models on these types of stimuli and conclude that the additional training data does not lead to a significant improvement of their ability to find odd-one-out targets.


page 1

page 3

page 4

page 6

page 8


A Novel Method to Study Bottom-up Visual Saliency and its Neural Mechanism

In this study, we propose a novel method to measure bottom-up saliency m...

Saliency Prediction in the Deep Learning Era: An Empirical Investigation

Visual saliency models have enjoyed a big leap in performance in recent ...

Light Field Saliency Detection with Deep Convolutional Networks

CNN-based methods have been proven to work well for saliency detection o...

Bottom-up Attention, Models of

In this review, we examine the recent progress in saliency prediction an...

Saccade Sequence Prediction: Beyond Static Saliency Maps

Visual attention is a field with a considerable history, with eye moveme...

Leverage eye-movement data for saliency modeling: Invariance Analysis and a Robust New Model

Data size is the bottleneck for developing deep saliency models, because...

Saliency Prediction for Mobile User Interfaces

We introduce models for saliency prediction for mobile user interfaces. ...

Please sign up or login with your details

Forgot password? Click here to reset