An Alternative to WSSS? An Empirical Study of the Segment Anything Model (SAM) on Weakly-Supervised Semantic Segmentation Problems

05/02/2023
by   Weixuan Sun, et al.
0

The Segment Anything Model (SAM) has demonstrated exceptional performance and versatility, making it a promising tool for various related tasks. In this report, we explore the application of SAM in Weakly-Supervised Semantic Segmentation (WSSS). Particularly, we adapt SAM as the pseudo-label generation pipeline given only the image-level class labels. While we observed impressive results in most cases, we also identify certain limitations. Our study includes performance evaluations on PASCAL VOC and MS-COCO, where we achieved remarkable improvements over the latest state-of-the-art methods on both datasets. We anticipate that this report encourages further explorations of adopting SAM in WSSS, as well as wider real-world applications.

READ FULL TEXT

page 2

page 3

research
05/02/2023

Segment Anything is A Good Pseudo-label Generator for Weakly Supervised Semantic Segmentation

Weakly supervised semantic segmentation with weak labels is a long-lived...
research
12/24/2019

A Comprehensive Analysis of Weakly-Supervised Semantic Segmentation in Different Image Domains

Recently proposed methods for weakly-supervised semantic segmentation ha...
research
05/21/2023

P-NOC: Adversarial CAM Generation for Weakly Supervised Semantic Segmentation

To mitigate the necessity for large amounts of supervised segmentation a...
research
05/09/2023

Segment Anything Model (SAM) Enhanced Pseudo Labels for Weakly Supervised Semantic Segmentation

Weakly Supervised Semantic Segmentation (WSSS) with only image-level sup...
research
05/29/2019

Closed-Loop Adaptation for Weakly-Supervised Semantic Segmentation

Weakly-supervised semantic segmentation aims to assign each pixel a sema...
research
11/22/2022

ISIM: Iterative Self-Improved Model for Weakly Supervised Segmentation

Weakly Supervised Semantic Segmentation (WSSS) is a challenging task aim...
research
12/07/2016

Bottom-Up Top-Down Cues for Weakly-Supervised Semantic Segmentation

We consider the task of learning a classifier for semantic segmentation ...

Please sign up or login with your details

Forgot password? Click here to reset