Few-Shot Segmentation via Rich Prototype Generation and Recurrent Prediction Enhancement

10/03/2022
by   Hongsheng Wang, et al.
0

Prototype learning and decoder construction are the keys for few-shot segmentation. However, existing methods use only a single prototype generation mode, which can not cope with the intractable problem of objects with various scales. Moreover, the one-way forward propagation adopted by previous methods may cause information dilution from registered features during the decoding process. In this research, we propose a rich prototype generation module (RPGM) and a recurrent prediction enhancement module (RPEM) to reinforce the prototype learning paradigm and build a unified memory-augmented decoder for few-shot segmentation, respectively. Specifically, the RPGM combines superpixel and K-means clustering to generate rich prototype features with complementary scale relationships and adapt the scale gap between support and query images. The RPEM utilizes the recurrent mechanism to design a round-way propagation decoder. In this way, registered features can provide object-aware information continuously. Experiments show that our method consistently outperforms other competitors on two popular benchmarks PASCAL-5^i and COCO-20^i.

READ FULL TEXT

page 9

page 10

research
03/08/2022

Contrastive Enhancement Using Latent Prototype for Few-Shot Segmentation

Few-shot segmentation enables the model to recognize unseen classes with...
research
04/22/2022

Dynamic Prototype Convolution Network for Few-Shot Semantic Segmentation

The key challenge for few-shot semantic segmentation (FSS) is how to tai...
research
02/10/2020

Prototype Refinement Network for Few-Shot Segmentation

Few-shot segmentation targets to segment new classes with few annotated ...
research
08/04/2021

Boosting Few-shot Semantic Segmentation with Transformers

Due to the fact that fully supervised semantic segmentation methods requ...
research
04/05/2021

Adaptive Prototype Learning and Allocation for Few-Shot Segmentation

Prototype learning is extensively used for few-shot segmentation. Typica...
research
08/10/2020

Prototype Mixture Models for Few-shot Semantic Segmentation

Few-shot segmentation is challenging because objects within the support ...

Please sign up or login with your details

Forgot password? Click here to reset