Edge-aware Plug-and-play Scheme for Semantic Segmentation

03/18/2023
by   Jianye Yi, et al.
Shenzhen University
0

Semantic segmentation is a classic and fundamental computer vision problem dedicated to assigning each pixel with its corresponding class. Some recent methods introduce edge-based information for improving the segmentation performance. However these methods are specific and limited to certain network architectures, and they can not be transferred to other models or tasks. Therefore, we propose an abstract and universal edge supervision method called Edge-aware Plug-and-play Scheme (EPS), which can be easily and quickly applied to any semantic segmentation models. The core is edge-width/thickness preserving guided for semantic segmentation. The EPS first extracts the Edge Ground Truth (Edge GT) with a predefined edge thickness from the training data; and then for any network architecture, it directly copies the decoder head for the auxiliary task with the Edge GT supervision. To ensure the edge thickness preserving consistantly, we design a new boundarybased loss, called Polar Hausdorff (PH) Loss, for the auxiliary supervision. We verify the effectiveness of our EPS on the Cityscapes dataset using 22 models. The experimental results indicate that the proposed method can be seamlessly integrated into any state-of-the-art (SOTA) models with zero modification, resulting in promising enhancement of the segmentation performance.

READ FULL TEXT

page 4

page 6

07/17/2020

Edge-Preserving Guided Semantic Segmentation for VIPriors Challenge

Semantic segmentation is one of the most attractive research fields in c...
07/14/2020

JSENet: Joint Semantic Segmentation and Edge Detection Network for 3D Point Clouds

Semantic segmentation and semantic edge detection can be seen as two dua...
10/11/2022

TriangleNet: Edge Prior Augmented Network for Semantic Segmentation through Cross-Task Consistency

Semantic segmentation is a classic computer vision problem dedicated to ...
05/27/2017

CASENet: Deep Category-Aware Semantic Edge Detection

Boundary and edge cues are highly beneficial in improving a wide variety...
09/25/2018

Triply Supervised Decoder Networks for Joint Detection and Segmentation

Joint object detection and semantic segmentation can be applied to many ...
04/09/2018

Semantic Edge Detection with Diverse Deep Supervision

Semantic edge detection (SED), which aims at jointly extracting edges as...

Please sign up or login with your details

Forgot password? Click here to reset