Simpler Does It: Generating Semantic Labels with Objectness Guidance

10/20/2021
by   Md Amirul Islam, et al.
14

Existing weakly or semi-supervised semantic segmentation methods utilize image or box-level supervision to generate pseudo-labels for weakly labeled images. However, due to the lack of strong supervision, the generated pseudo-labels are often noisy near the object boundaries, which severely impacts the network's ability to learn strong representations. To address this problem, we present a novel framework that generates pseudo-labels for training images, which are then used to train a segmentation model. To generate pseudo-labels, we combine information from: (i) a class agnostic objectness network that learns to recognize object-like regions, and (ii) either image-level or bounding box annotations. We show the efficacy of our approach by demonstrating how the objectness network can naturally be leveraged to generate object-like regions for unseen categories. We then propose an end-to-end multi-task learning strategy, that jointly learns to segment semantics and objectness using the generated pseudo-labels. Extensive experiments demonstrate the high quality of our generated pseudo-labels and effectiveness of the proposed framework in a variety of domains. Our approach achieves better or competitive performance compared to existing weakly-supervised and semi-supervised methods.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 9

page 10

page 11

page 13

page 14

page 15

page 16

page 17

04/02/2021

Background-Aware Pooling and Noise-Aware Loss for Weakly-Supervised Semantic Segmentation

We address the problem of weakly-supervised semantic segmentation (WSSS)...
01/09/2022

Box2Seg: Learning Semantics of 3D Point Clouds with Box-Level Supervision

Learning dense point-wise semantics from unstructured 3D point clouds wi...
10/19/2020

PseudoSeg: Designing Pseudo Labels for Semantic Segmentation

Recent advances in semi-supervised learning (SSL) demonstrate that a com...
08/18/2018

Concept Mask: Large-Scale Segmentation from Semantic Concepts

Existing works on semantic segmentation typically consider a small numbe...
08/21/2019

Semantic-Transferable Weakly-Supervised Endoscopic Lesions Segmentation

Weakly-supervised learning under image-level labels supervision has been...
12/01/2021

Reference-guided Pseudo-Label Generation for Medical Semantic Segmentation

Producing densely annotated data is a difficult and tedious task for med...
02/18/2020

EHSOD: CAM-Guided End-to-end Hybrid-Supervised Object Detection with Cascade Refinement

Object detectors trained on fully-annotated data currently yield state o...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.