Visual Saliency Detection Based on Multiscale Deep CNN Features

09/07/2016
by   Guanbin Li, et al.
0

Visual saliency is a fundamental problem in both cognitive and computational sciences, including computer vision. In this paper, we discover that a high-quality visual saliency model can be learned from multiscale features extracted using deep convolutional neural networks (CNNs), which have had many successes in visual recognition tasks. For learning such saliency models, we introduce a neural network architecture, which has fully connected layers on top of CNNs responsible for feature extraction at three different scales. The penultimate layer of our neural network has been confirmed to be a discriminative high-level feature vector for saliency detection, which we call deep contrast feature. To generate a more robust feature, we integrate handcrafted low-level features with our deep contrast feature. To promote further research and evaluation of visual saliency models, we also construct a new large database of 4447 challenging images and their pixelwise saliency annotations. Experimental results demonstrate that our proposed method is capable of achieving state-of-the-art performance on all public benchmarks, improving the F- measure by 6.12 dataset and our new dataset (HKU-IS), and lowering the mean absolute error by 9

READ FULL TEXT

page 1

page 4

page 6

page 7

page 8

page 9

page 10

page 13

research
03/30/2015

Visual Saliency Based on Multiscale Deep Features

Visual saliency is a fundamental problem in both cognitive and computati...
research
09/05/2016

A Deep Multi-Level Network for Saliency Prediction

This paper presents a novel deep architecture for saliency prediction. C...
research
02/21/2018

Using Visual Saliency to Improve Human Detection with Convolutional Networks

In this paper, we demonstrate an approach based on visual saliency for d...
research
12/07/2021

SalFBNet: Learning Pseudo-Saliency Distribution via Feedback Convolutional Networks

Feed-forward only convolutional neural networks (CNNs) may ignore intrin...
research
04/10/2018

Pilot Comparative Study of Different Deep Features for Palmprint Identification in Low-Quality Images

Deep Convolutional Neural Networks (CNNs) are widespread, efficient tool...
research
02/04/2016

NeRD: a Neural Response Divergence Approach to Visual Salience Detection

In this paper, a novel approach to visual salience detection via Neural ...
research
07/22/2013

Visual saliency estimation by integrating features using multiple kernel learning

In the last few decades, significant achievements have been attained in ...

Please sign up or login with your details

Forgot password? Click here to reset