Self-supervised Image-specific Prototype Exploration for Weakly Supervised Semantic Segmentation

03/06/2022
by   Qi Chen, et al.
0

Weakly Supervised Semantic Segmentation (WSSS) based on image-level labels has attracted much attention due to low annotation costs. Existing methods often rely on Class Activation Mapping (CAM) that measures the correlation between image pixels and classifier weight. However, the classifier focuses only on the discriminative regions while ignoring other useful information in each image, resulting in incomplete localization maps. To address this issue, we propose a Self-supervised Image-specific Prototype Exploration (SIPE) that consists of an Image-specific Prototype Exploration (IPE) and a General-Specific Consistency (GSC) loss. Specifically, IPE tailors prototypes for every image to capture complete regions, formed our Image-Specific CAM (IS-CAM), which is realized by two sequential steps. In addition, GSC is proposed to construct the consistency of general CAM and our specific IS-CAM, which further optimizes the feature representation and empowers a self-correction ability of prototype exploration. Extensive experiments are conducted on PASCAL VOC 2012 and MS COCO 2014 segmentation benchmark and results show our SIPE achieves new state-of-the-art performance using only image-level labels. The code is available at https://github.com/chenqi1126/SIPE.

READ FULL TEXT

page 1

page 3

page 4

page 6

page 7

page 8

research
03/12/2021

Discriminative Region Suppression for Weakly-Supervised Semantic Segmentation

Weakly-supervised semantic segmentation (WSSS) using image-level labels ...
research
04/18/2023

Coupling Global Context and Local Contents for Weakly-Supervised Semantic Segmentation

Thanks to the advantages of the friendly annotations and the satisfactor...
research
10/13/2021

Reducing Information Bottleneck for Weakly Supervised Semantic Segmentation

Weakly supervised semantic segmentation produces pixel-level localizatio...
research
04/14/2022

RecurSeed and CertainMix for Weakly Supervised Semantic Segmentation

Although weakly supervised semantic segmentation using only image-level ...
research
12/05/2022

SASFormer: Transformers for Sparsely Annotated Semantic Segmentation

Semantic segmentation based on sparse annotation has advanced in recent ...
research
04/21/2022

Beyond the Prototype: Divide-and-conquer Proxies for Few-shot Segmentation

Few-shot segmentation, which aims to segment unseen-class objects given ...
research
11/22/2022

ISIM: Iterative Self-Improved Model for Weakly Supervised Segmentation

Weakly Supervised Semantic Segmentation (WSSS) is a challenging task aim...

Please sign up or login with your details

Forgot password? Click here to reset