Weakly-Supervised Salient Object Detection via Scribble Annotations

03/17/2020
by   Jing Zhang, et al.
5

Compared with laborious pixel-wise dense labeling, it is much easier to label data by scribbles, which only costs 1∼2 seconds to label one image. However, using scribble labels to learn salient object detection has not been explored. In this paper, we propose a weakly-supervised salient object detection model to learn saliency from such annotations. In doing so, we first relabel an existing large-scale salient object detection dataset with scribbles, namely S-DUTS dataset. Since object structure and detail information is not identified by scribbles, directly training with scribble labels will lead to saliency maps of poor boundary localization. To mitigate this problem, we propose an auxiliary edge detection task to localize object edges explicitly, and a gated structure-aware loss to place constraints on the scope of structure to be recovered. Moreover, we design a scribble boosting scheme to iteratively consolidate our scribble annotations, which are then employed as supervision to learn high-quality saliency maps. As existing saliency evaluation metrics neglect to measure structure alignment of the predictions, the saliency map ranking metric may not comply with human perception. We present a new metric, termed saliency structure measure, to measure the structure alignment of the predicted saliency maps, which is more consistent with human perception. Extensive experiments on six benchmark datasets demonstrate that our method not only outperforms existing weakly-supervised/unsupervised methods, but also is on par with several fully-supervised state-of-the-art models. Our code and data is publicly available at https://github.com/JingZhang617/Scribble_Saliency.

READ FULL TEXT

page 1

page 2

page 4

page 5

page 6

page 7

research
03/22/2022

Weakly-Supervised Salient Object Detection Using Point Supervison

Current state-of-the-art saliency detection models rely heavily on large...
research
03/09/2022

3SD: Self-Supervised Saliency Detection With No Labels

We present a conceptually simple self-supervised method for saliency det...
research
02/07/2022

Scribble-based Boundary-aware Network for Weakly Supervised Salient Object Detection in Remote Sensing Images

Existing CNNs-based salient object detection (SOD) heavily depends on th...
research
12/08/2020

Structure-Consistent Weakly Supervised Salient Object Detection with Local Saliency Coherence

Sparse labels have been attracting much attention in recent years. Howev...
research
12/03/2021

MFNet: Multi-filter Directive Network for Weakly Supervised Salient Object Detection

Weakly supervised salient object detection (WSOD) targets to train a CNN...
research
02/26/2022

Unsupervised Domain Adaptive Salient Object Detection Through Uncertainty-Aware Pseudo-Label Learning

Recent advances in deep learning significantly boost the performance of ...
research
10/25/2022

Synthetic Data Supervised Salient Object Detection

Although deep salient object detection (SOD) has achieved remarkable pro...

Please sign up or login with your details

Forgot password? Click here to reset