Hierarchical Cellular Automata for Visual Saliency

05/26/2017
by   Yao Qin, et al.
0

Saliency detection, finding the most important parts of an image, has become increasingly popular in computer vision. In this paper, we introduce Hierarchical Cellular Automata (HCA) -- a temporally evolving model to intelligently detect salient objects. HCA consists of two main components: Single-layer Cellular Automata (SCA) and Cuboid Cellular Automata (CCA). As an unsupervised propagation mechanism, Single-layer Cellular Automata can exploit the intrinsic relevance of similar regions through interactions with neighbors. Low-level image features as well as high-level semantic information extracted from deep neural networks are incorporated into the SCA to measure the correlation between different image patches. With these hierarchical deep features, an impact factor matrix and a coherence matrix are constructed to balance the influences on each cell's next state. The saliency values of all cells are iteratively updated according to a well-defined update rule. Furthermore, we propose CCA to integrate multiple saliency maps generated by SCA at different scales in a Bayesian framework. Therefore, single-layer propagation and multi-layer integration are jointly modeled in our unified HCA. Surprisingly, we find that the SCA can improve all existing methods that we applied it to, resulting in a similar precision level regardless of the original results. The CCA can act as an efficient pixel-wise aggregation algorithm that can integrate state-of-the-art methods, resulting in even better results. Extensive experiments on four challenging datasets demonstrate that the proposed algorithm outperforms state-of-the-art conventional methods and is competitive with deep learning based approaches.

READ FULL TEXT

page 2

page 3

page 6

page 8

page 9

page 10

page 12

page 15

research
02/01/2016

A Deep Learning Based Fast Image Saliency Detection Algorithm

In this paper, we propose a fast deep learning method for object salienc...
research
12/01/2021

Saliency Enhancement using Superpixel Similarity

Saliency Object Detection (SOD) has several applications in image analys...
research
06/29/2017

Co-salient Object Detection Based on Deep Saliency Networks and Seed Propagation over an Integrated Graph

This paper presents a co-salient object detection method to find common ...
research
09/24/2017

Can Image Retrieval help Visual Saliency Detection?

We propose a novel image retrieval framework for visual saliency detecti...
research
10/02/2020

Video Saliency Detection with Domain Adaptation using Hierarchical Gradient Reversal Layers

In this work, we propose a 3D fully convolutional architecture for video...
research
03/05/2016

Saliency Detection combining Multi-layer Integration algorithm with background prior and energy function

In this paper, we propose an improved mechanism for saliency detection. ...
research
01/23/2015

Unsupervised Segmentation of Multispectral Images with Cellular Automata

Multispectral images acquired by satellites are used to study phenomena ...

Please sign up or login with your details

Forgot password? Click here to reset