Beyond the Prototype: Divide-and-conquer Proxies for Few-shot Segmentation

04/21/2022
by   Chunbo Lang, et al.
8

Few-shot segmentation, which aims to segment unseen-class objects given only a handful of densely labeled samples, has received widespread attention from the community. Existing approaches typically follow the prototype learning paradigm to perform meta-inference, which fails to fully exploit the underlying information from support image-mask pairs, resulting in various segmentation failures, e.g., incomplete objects, ambiguous boundaries, and distractor activation. To this end, we propose a simple yet versatile framework in the spirit of divide-and-conquer. Specifically, a novel self-reasoning scheme is first implemented on the annotated support image, and then the coarse segmentation mask is divided into multiple regions with different properties. Leveraging effective masked average pooling operations, a series of support-induced proxies are thus derived, each playing a specific role in conquering the above challenges. Moreover, we devise a unique parallel decoder structure that integrates proxies with similar attributes to boost the discrimination power. Our proposed approach, named divide-and-conquer proxies (DCP), allows for the development of appropriate and reliable information as a guide at the "episode" level, not just about the object cues themselves. Extensive experiments on PASCAL-5i and COCO-20i demonstrate the superiority of DCP over conventional prototype-based approaches (up to 5 10 which also establishes a new state-of-the-art. Code is available at github.com/chunbolang/DCP.

READ FULL TEXT

page 1

page 3

page 4

page 6

research
03/30/2021

Self-Guided and Cross-Guided Learning for Few-Shot Segmentation

Few-shot segmentation has been attracting a lot of attention due to its ...
research
02/22/2021

Semantically Meaningful Class Prototype Learning for One-Shot Image Semantic Segmentation

One-shot semantic image segmentation aims to segment the object regions ...
research
06/20/2022

MSANet: Multi-Similarity and Attention Guidance for Boosting Few-Shot Segmentation

Few-shot segmentation aims to segment unseen-class objects given only a ...
research
03/06/2022

Self-supervised Image-specific Prototype Exploration for Weakly Supervised Semantic Segmentation

Weakly Supervised Semantic Segmentation (WSSS) based on image-level labe...
research
10/22/2018

SG-One: Similarity Guidance Network for One-Shot Semantic Segmentation

One-shot semantic segmentation poses a challenging task of recognizing t...
research
03/15/2022

Learning What Not to Segment: A New Perspective on Few-Shot Segmentation

Recently few-shot segmentation (FSS) has been extensively developed. Mos...
research
04/05/2021

Adaptive Prototype Learning and Allocation for Few-Shot Segmentation

Prototype learning is extensively used for few-shot segmentation. Typica...

Please sign up or login with your details

Forgot password? Click here to reset