DeepAI AI Chat
Log In Sign Up

Boundary Knowledge Translation based Reference Semantic Segmentation

08/01/2021
by   Lechao Cheng, et al.
National University of Singapore
Zhejiang University
Zhejiang University of Technology
0

Given a reference object of an unknown type in an image, human observers can effortlessly find the objects of the same category in another image and precisely tell their visual boundaries. Such visual cognition capability of humans seems absent from the current research spectrum of computer vision. Existing segmentation networks, for example, rely on a humongous amount of labeled data, which is laborious and costly to collect and annotate; besides, the performance of segmentation networks tend to downgrade as the number of the category increases. In this paper, we introduce a novel Reference semantic segmentation Network (Ref-Net) to conduct visual boundary knowledge translation. Ref-Net contains a Reference Segmentation Module (RSM) and a Boundary Knowledge Translation Module (BKTM). Inspired by the human recognition mechanism, RSM is devised only to segment the same category objects based on the features of the reference objects. BKTM, on the other hand, introduces two boundary discriminator branches to conduct inner and outer boundary segmentation of the target objectin an adversarial manner, and translate the annotated boundary knowledge of open-source datasets into the segmentation network. Exhaustive experiments demonstrate that, with tens of finely-grained annotated samples as guidance, Ref-Net achieves results on par with fully supervised methods on six datasets.

READ FULL TEXT
08/01/2021

Visual Boundary Knowledge Translation for Foreground Segmentation

When confronted with objects of unknown types in an image, humans can ef...
05/07/2022

Comparison Knowledge Translation for Generalizable Image Classification

Deep learning has recently achieved remarkable performance in image clas...
05/25/2021

BoundarySqueeze: Image Segmentation as Boundary Squeezing

We propose a novel method for fine-grained high-quality image segmentati...
10/27/2021

Boundary Guided Context Aggregation for Semantic Segmentation

The recent studies on semantic segmentation are starting to notice the s...
07/09/2022

SHDM-NET: Heat Map Detail Guidance with Image Matting for Industrial Weld Semantic Segmentation Network

In actual industrial production, the assessment of the steel plate weldi...
11/03/2019

Leveraging Pretrained Image Classifiers for Language-Based Segmentation

Current semantic segmentation models cannot easily generalize to new obj...
08/12/2022

Semantic decomposition Network with Contrastive and Structural Constraints for Dental Plaque Segmentation

Segmenting dental plaque from images of medical reagent staining provide...