Agile Amulet: Real-Time Salient Object Detection with Contextual Attention

by   Pingping Zhang, et al.

This paper proposes an Agile Aggregating Multi-Level feaTure framework (Agile Amulet) for salient object detection. The Agile Amulet builds on previous works to predict saliency maps using multi-level convolutional features. Compared to previous works, Agile Amulet employs some key innovations to improve training and testing speed while also increase prediction accuracy. More specifically, we first introduce a contextual attention module that can rapidly highlight most salient objects or regions with contextual pyramids. Thus, it effectively guides the learning of low-layer convolutional features and tells the backbone network where to look. The contextual attention module is a fully convolutional mechanism that simultaneously learns complementary features and predicts saliency scores at each pixel. In addition, we propose a novel method to aggregate multi-level deep convolutional features. As a result, we are able to use the integrated side-output features of pre-trained convolutional networks alone, which significantly reduces the model parameters leading to a model size of 67 MB, about half of Amulet. Compared to other deep learning based saliency methods, Agile Amulet is of much lighter-weight, runs faster (30 fps in real-time) and achieves higher performance on seven public benchmarks in terms of both quantitative and qualitative evaluation.


page 1

page 3

page 8


Amulet: Aggregating Multi-level Convolutional Features for Salient Object Detection

Fully convolutional neural networks (FCNs) have shown outstanding perfor...

Boundary-guided Feature Aggregation Network for Salient Object Detection

Fully convolutional networks (FCN) has significantly improved the perfor...

DFNet: Discriminative feature extraction and integration network for salient object detection

Despite the powerful feature extraction capability of Convolutional Neur...

Deep Reasoning with Multi-scale Context for Salient Object Detection

To detect and segment salient objects accurately, existing methods are u...

PiCANet: Pixel-wise Contextual Attention Learning for Accurate Saliency Detection

In saliency detection, every pixel needs contextual information to make ...

Contrast-Oriented Deep Neural Networks for Salient Object Detection

Deep convolutional neural networks have become a key element in the rece...

A Unified Light Framework for Real-time Fault Detection of Freight Train Images

Real-time fault detection for freight trains plays a vital role in guara...

Please sign up or login with your details

Forgot password? Click here to reset