Learning structure-aware semantic segmentation with image-level supervision

04/15/2021
by   Jiawei Liu, et al.
0

Compared with expensive pixel-wise annotations, image-level labels make it possible to learn semantic segmentation in a weakly-supervised manner. Within this pipeline, the class activation map (CAM) is obtained and further processed to serve as a pseudo label to train the semantic segmentation model in a fully-supervised manner. In this paper, we argue that the lost structure information in CAM limits its application in downstream semantic segmentation, leading to deteriorated predictions. Furthermore, the inconsistent class activation scores inside the same object contradicts the common sense that each region of the same object should belong to the same semantic category. To produce sharp prediction with structure information, we introduce an auxiliary semantic boundary detection module, which penalizes the deteriorated predictions. Furthermore, we adopt smoothness loss to encourage prediction inside the object to be consistent. Experimental results on the PASCAL-VOC dataset illustrate the effectiveness of the proposed solution.

READ FULL TEXT

page 1

page 3

page 5

page 8

research
12/10/2021

Exploring Pixel-level Self-supervision for Weakly Supervised Semantic Segmentation

Existing studies in weakly supervised semantic segmentation (WSSS) have ...
research
08/09/2021

Complementary Patch for Weakly Supervised Semantic Segmentation

Weakly Supervised Semantic Segmentation (WSSS) based on image-level labe...
research
06/20/2022

Saliency Guided Inter- and Intra-Class Relation Constraints for Weakly Supervised Semantic Segmentation

Weakly supervised semantic segmentation with only image-level labels aim...
research
07/10/2020

PCAMs: Weakly Supervised Semantic Segmentation Using Point Supervision

Current state of the art methods for generating semantic segmentation re...
research
10/22/2022

SLAM: Semantic Learning based Activation Map for Weakly Supervised Semantic Segmentation

Recent mainstream weakly-supervised semantic segmentation (WSSS) approac...
research
11/22/2022

Out-of-Candidate Rectification for Weakly Supervised Semantic Segmentation

Weakly supervised semantic segmentation is typically inspired by class a...
research
07/28/2022

Weakly-Supervised Camouflaged Object Detection with Scribble Annotations

Existing camouflaged object detection (COD) methods rely heavily on larg...

Please sign up or login with your details

Forgot password? Click here to reset