Region-level Contrastive and Consistency Learning for Semi-Supervised Semantic Segmentation

04/28/2022
by   Jianrong Zhang, et al.
0

Current semi-supervised semantic segmentation methods mainly focus on designing pixel-level consistency and contrastive regularization. However, pixel-level regularization is sensitive to noise from pixels with incorrect predictions, and pixel-level contrastive regularization has memory and computational cost with O(pixel_num^2). To address the issues, we propose a novel region-level contrastive and consistency learning framework (RC^2L) for semi-supervised semantic segmentation. Specifically, we first propose a Region Mask Contrastive (RMC) loss and a Region Feature Contrastive (RFC) loss to accomplish region-level contrastive property. Furthermore, Region Class Consistency (RCC) loss and Semantic Mask Consistency (SMC) loss are proposed for achieving region-level consistency. Based on the proposed region-level contrastive and consistency regularization, we develop a region-level contrastive and consistency learning framework (RC^2L) for semi-supervised semantic segmentation, and evaluate our RC^2L on two challenging benchmarks (PASCAL VOC 2012 and Cityscapes), outperforming the state-of-the-art.

READ FULL TEXT

page 3

page 6

page 9

research
08/20/2021

Pixel Contrastive-Consistent Semi-Supervised Semantic Segmentation

We present a novel semi-supervised semantic segmentation method which jo...
research
04/27/2021

Semi-Supervised Semantic Segmentation with Pixel-Level Contrastive Learning from a Class-wise Memory Bank

This work presents a novel approach for semi-supervised semantic segment...
research
04/09/2021

Bootstrapping Semantic Segmentation with Regional Contrast

We present ReCo, a contrastive learning framework designed at a regional...
research
01/14/2020

Structured Consistency Loss for semi-supervised semantic segmentation

The consistency loss has played a key role in solving problems in recent...
research
11/28/2022

Semi-Supervised Confidence-Level-based Contrastive Discrimination for Class-Imbalanced Semantic Segmentation

To overcome the data-hungry challenge, we have proposed a semi-supervise...
research
04/18/2023

Motion-state Alignment for Video Semantic Segmentation

In recent years, video semantic segmentation has made great progress wit...
research
10/26/2022

Boosting Semi-Supervised Semantic Segmentation with Probabilistic Representations

Recent breakthroughs in semi-supervised semantic segmentation have been ...

Please sign up or login with your details

Forgot password? Click here to reset