BiOpt: Bi-Level Optimization for Few-Shot Segmentation

11/23/2020
by   Jinlu Liu, et al.
0

Few-shot segmentation is a challenging task that aims to segment objects of new classes given scarce support images. In the inductive setting, existing prototype-based methods focus on extracting prototypes from the support images; however, they fail to utilize semantic information of the query images. In this paper, we propose Bi-level Optimization (BiOpt), which succeeds to compute class prototypes from the query images under inductive setting. The learning procedure of BiOpt is decomposed into two nested loops: inner and outer loop. On each task, the inner loop aims to learn optimized prototypes from the query images. An init step is conducted to fully exploit knowledge from both support and query features, so as to give reasonable initialized prototypes into the inner loop. The outer loop aims to learn a discriminative embedding space across different tasks. Extensive experiments on two benchmarks verify the superiority of our proposed BiOpt algorithm. In particular, we consistently achieve the state-of-the-art performance on 5-shot PASCAL-5^i and 1-shot COCO-20^i.

READ FULL TEXT

page 2

page 8

research
04/12/2020

Self-Supervised Tuning for Few-Shot Segmentation

Few-shot segmentation aims at assigning a category label to each image p...
research
08/11/2021

Few-Shot Segmentation with Global and Local Contrastive Learning

In this work, we address the challenging task of few-shot segmentation. ...
research
02/10/2020

Prototype Refinement Network for Few-Shot Segmentation

Few-shot segmentation targets to segment new classes with few annotated ...
research
12/09/2021

A Fully Single Loop Algorithm for Bilevel Optimization without Hessian Inverse

In this paper, we propose a new Hessian inverse free Fully Single Loop A...
research
08/10/2020

Prototype Mixture Models for Few-shot Semantic Segmentation

Few-shot segmentation is challenging because objects within the support ...
research
09/18/2023

Target-aware Bi-Transformer for Few-shot Segmentation

Traditional semantic segmentation tasks require a large number of labels...
research
03/09/2018

Exploiting Friction in Torque Controlled Humanoid Robots

A common architecture for torque controlled humanoid robots consists in ...

Please sign up or login with your details

Forgot password? Click here to reset