A New Local Transformation Module for Few-shot Segmentation

10/14/2019
by   Yuwei Yang, et al.
0

Few-shot segmentation segments object regions of new classes with a few of manual annotations. Its key step is to establish the transformation module between support images (annotated images) and query images (unlabeled images), so that the segmentation cues of support images can guide the segmentation of query images. The existing methods form transformation model based on global cues, which however ignores the local cues that are verified in this paper to be very important for the transformation. This paper proposes a new transformation module based on local cues, where the relationship of the local features is used for transformation. To enhance the generalization performance of the network, the relationship matrix is calculated in a high-dimensional metric embedding space based on cosine distance. In addition, to handle the challenging mapping problem from the low-level local relationships to high-level semantic cues, we propose to apply generalized inverse matrix of the annotation matrix of support images to transform the relationship matrix linearly, which is non-parametric and class-agnostic. The result by the matrix transformation can be regarded as an attention map with high-level semantic cues, based on which a transformation module can be built simply.The proposed transformation module is a general module that can be used to replace the transformation module in the existing few-shot segmentation frameworks. We verify the effectiveness of the proposed method on Pascal VOC 2012 dataset. The value of mIoU achieves at 57.0 outperforms the state-of-the-art method by 1.6

READ FULL TEXT
research
09/19/2019

A New Few-shot Segmentation Network Based on Class Representation

This paper studies few-shot segmentation, which is a task of predicting ...
research
03/17/2022

Multi-similarity based Hyperrelation Network for few-shot segmentation

Few-shot semantic segmentation aims at recognizing the object regions of...
research
04/04/2021

Hypercorrelation Squeeze for Few-Shot Segmentation

Few-shot semantic segmentation aims at learning to segment a target obje...
research
10/22/2020

Task-Adaptive Feature Transformer for Few-Shot Segmentation

Few-shot learning allows machines to classify novel classes using only a...
research
08/19/2021

Few-shot Segmentation with Optimal Transport Matching and Message Flow

We address the challenging task of few-shot segmentation in this work. I...
research
05/23/2023

MIANet: Aggregating Unbiased Instance and General Information for Few-Shot Semantic Segmentation

Existing few-shot segmentation methods are based on the meta-learning st...
research
01/23/2019

Class Activation Map Generation by Representative Class Selection and Multi-Layer Feature Fusion

Existing method generates class activation map (CAM) by a set of fixed c...

Please sign up or login with your details

Forgot password? Click here to reset