Semantic and Contrast-Aware Saliency

11/09/2018
by   Xiaoshuai Sun, et al.
0

In this paper, we proposed an integrated model of semantic-aware and contrast-aware saliency combining both bottom-up and top-down cues for effective saliency estimation and eye fixation prediction. The proposed model processes visual information using two pathways. The first pathway aims to capture the attractive semantic information in images, especially for the presence of meaningful objects and object parts such as human faces. The second pathway is based on multi-scale on-line feature learning and information maximization, which learns an adaptive sparse representation for the input and discovers the high contrast salient patterns within the image context. The two pathways characterize both long-term and short-term attention cues and are integrated dynamically using maxima normalization. We investigate two different implementations of the semantic pathway including an End-to-End deep neural network solution and a dynamic feature integration solution, resulting in the SCA and SCAFI model respectively. Experimental results on artificial images and 5 popular benchmark datasets demonstrate the superior performance and better plausibility of the proposed model over both classic approaches and recent deep models.

READ FULL TEXT

page 1

page 4

page 5

page 7

page 8

page 11

research
10/06/2016

A Deep Spatial Contextual Long-term Recurrent Convolutional Network for Saliency Detection

Traditional saliency models usually adopt hand-crafted image features an...
research
10/19/2015

DeepSaliency: Multi-Task Deep Neural Network Model for Salient Object Detection

A key problem in salient object detection is how to effectively model th...
research
07/08/2021

Instance-Level Relative Saliency Ranking with Graph Reasoning

Conventional salient object detection models cannot differentiate the im...
research
11/10/2020

CoADNet: Collaborative Aggregation-and-Distribution Networks for Co-Salient Object Detection

Co-Salient Object Detection (CoSOD) aims at discovering salient objects ...
research
05/07/2017

Deep Visual Attention Prediction

Deep Convolutional Neural Networks (CNNs) have made substantial improvem...
research
03/27/2016

Recurrent Mixture Density Network for Spatiotemporal Visual Attention

In many computer vision tasks, the relevant information to solve the pro...
research
01/02/2020

Video Saliency Prediction Using Enhanced Spatiotemporal Alignment Network

Due to a variety of motions across different frames, it is highly challe...

Please sign up or login with your details

Forgot password? Click here to reset