Multi-Context Interaction Network for Few-Shot Segmentation

03/11/2023
by   Hao Chen, et al.
0

Few-Shot Segmentation (FSS) is challenging for limited support images and large intra-class appearance discrepancies. Due to the huge difference between support and query samples, most existing approaches focus on extracting high-level representations of the same layers for support-query correlations but neglect the shift issue between different layers and scales. In this paper, we propose a Multi-Context Interaction Network (MCINet) to remedy this issue by fully exploiting and interacting with the multi-scale contextual information contained in the support-query pairs. Specifically, MCINet improves FSS from the perspectives of boosting the query representations by incorporating the low-level structural information from another query branch into the high-level semantic features, enhancing the support-query correlations by exploiting both the same-layer and adjacent-layer features, and refining the predicted results by a multi-scale mask prediction strategy, with which the different scale contents have bidirectionally interacted. Experiments on two benchmarks demonstrate that our approach reaches SOTA performances and outperforms the best competitors with many desirable advantages, especially on the challenging COCO dataset.

READ FULL TEXT

page 1

page 3

page 5

page 8

page 9

research
07/18/2022

Dense Cross-Query-and-Support Attention Weighted Mask Aggregation for Few-Shot Segmentation

Research into Few-shot Semantic Segmentation (FSS) has attracted great a...
research
06/03/2021

Multi-Scale Feature Aggregation by Cross-Scale Pixel-to-Region Relation Operation for Semantic Segmentation

Exploiting multi-scale features has shown great potential in tackling se...
research
05/31/2022

Progressive Multi-scale Consistent Network for Multi-class Fundus Lesion Segmentation

Effectively integrating multi-scale information is of considerable signi...
research
11/30/2020

Multi-scale Adaptive Task Attention Network for Few-Shot Learning

The goal of few-shot learning is to classify unseen categories with few ...
research
10/18/2021

Uncertainty-Aware Semi-Supervised Few Shot Segmentation

Few shot segmentation (FSS) aims to learn pixel-level classification of ...
research
09/28/2021

PFENet++: Boosting Few-shot Semantic Segmentation with the Noise-filtered Context-aware Prior Mask

In this work, we revisit the prior mask guidance proposed in "Prior Guid...
research
11/04/2018

Query-based Logo Segmentation

Logo detection in real-world scene images is an important problem with u...

Please sign up or login with your details

Forgot password? Click here to reset