PiCANet: Pixel-wise Contextual Attention Learning for Accurate Saliency Detection

12/15/2018
by   Nian Liu, et al.
0

In saliency detection, every pixel needs contextual information to make saliency prediction. Previous models usually incorporate contexts holistically. However, for each pixel, usually only part of its context region is useful and contributes to its prediction, while some other part may serve as noises and distractions. In this paper, we propose a novel pixel-wise contextual attention network, PiCANet, to learn to selectively attend to informative context locations at each pixel. Specifically, PiCANet generates an attention map over the context region of each pixel, where each attention weight corresponds to the relevance of a context location w.r.t the referred pixel. Then, attentive contextual features can be constructed via selectively incorporating the features of useful context locations with the learned attention. We propose three specific formulations of the PiCANet via embedding the pixel-wise contextual attention mechanism into the pooling and convolution operations with attending to global or local contexts. All the three models are fully differentiable and can be integrated with CNNs with joint training. We introduce the proposed PiCANets into a U-Net architecture for salient object detection. Experimental results indicate that the proposed PiCANets can significantly improve the saliency detection performance. The generated global and local attention can learn to incorporate global contrast and smoothness, respectively, which help localize salient objects more accurately and highlight them more uniformly. Consequently, our saliency model performs favorably against other state-of-the-art methods. Moreover, we also validate that PiCANets can also improve semantic segmentation and object detection performances, which further demonstrates their effectiveness and generalization ability.

READ FULL TEXT

page 2

page 6

page 8

page 9

page 11

page 12

page 13

research
08/10/2020

Rethinking of the Image Salient Object Detection: Object-level Semantic Saliency Re-ranking First, Pixel-wise Saliency Refinement Latter

The real human attention is an interactive activity between our visual s...
research
12/08/2019

SaLite : A light-weight model for salient object detection

Salient object detection is a prevalent computer vision task that has ap...
research
03/24/2016

Attentive Contexts for Object Detection

Modern deep neural network based object detection methods typically clas...
research
12/28/2018

Salient Object Detection via High-to-Low Hierarchical Context Aggregation

Recent progress on salient object detection mainly aims at exploiting ho...
research
08/04/2018

Troy: Give Attention to Saliency and for Saliency

Saliency detection or foreground segmentation is a fundamental and impor...
research
02/20/2018

Agile Amulet: Real-Time Salient Object Detection with Contextual Attention

This paper proposes an Agile Aggregating Multi-Level feaTure framework (...
research
03/27/2018

Three Birds One Stone: A Unified Framework for Salient Object Segmentation, Edge Detection and Skeleton Extraction

In this paper, we aim at solving pixel-wise binary problems, including s...

Please sign up or login with your details

Forgot password? Click here to reset