DeepAI AI Chat
Log In Sign Up

Task-Adaptive Feature Transformer with Semantic Enrichment for Few-Shot Segmentation

02/14/2022
by   Jun Seo, et al.
9

Few-shot learning allows machines to classify novel classes using only a few labeled samples. Recently, few-shot segmentation aiming at semantic segmentation on low sample data has also seen great interest. In this paper, we propose a learnable module that can be placed on top of existing segmentation networks for performing few-shot segmentation. This module, called the task-adaptive feature transformer (TAFT), linearly transforms task-specific high-level features to a set of task agnostic features well-suited to conducting few-shot segmentation. The task-conditioned feature transformation allows an effective utilization of the semantic information in novel classes to generate tight segmentation masks. We also propose a semantic enrichment (SE) module that utilizes a pixel-wise attention module for high-level feature and an auxiliary loss from an auxiliary segmentation network conducting the semantic segmentation for all training classes. Experiments on PASCAL-5^i and COCO-20^i datasets confirm that the added modules successfully extend the capability of existing segmentators to yield highly competitive few-shot segmentation performances.

READ FULL TEXT

page 6

page 14

page 15

page 16

10/22/2020

Task-Adaptive Feature Transformer for Few-Shot Segmentation

Few-shot learning allows machines to classify novel classes using only a...
06/04/2021

Few-Shot Segmentation via Cycle-Consistent Transformer

Few-shot segmentation aims to train a segmentation model that can fast a...
10/15/2022

Prediction Calibration for Generalized Few-shot Semantic Segmentation

Generalized Few-shot Semantic Segmentation (GFSS) aims to segment each i...
03/18/2020

CAFENet: Class-Agnostic Few-Shot Edge Detection Network

We tackle a novel few-shot learning challenge, which we call few-shot se...
12/03/2020

Single-shot Path Integrated Panoptic Segmentation

Panoptic segmentation, which is a novel task of unifying instance segmen...
10/14/2019

A New Local Transformation Module for Few-shot Segmentation

Few-shot segmentation segments object regions of new classes with a few ...
10/13/2022

Feature-Proxy Transformer for Few-Shot Segmentation

Few-shot segmentation (FSS) aims at performing semantic segmentation on ...

Code Repositories

TAFT-SE

Pytorch Implementation of Task-Adaptive Feature Transformer with Semantic Enrichment for Few-Shot Segmentation


view repo