Transductive Episodic-Wise Adaptive Metric for Few-Shot Learning

10/05/2019
by   Limeng Qiao, et al.
0

Few-shot learning, which aims at extracting new concepts rapidly from extremely few examples of novel classes, has been featured into the meta-learning paradigm recently. Yet, the key challenge of how to learn a generalizable classifier with the capability of adapting to specific tasks with severely limited data still remains in this domain. To this end, we propose a Transductive Episodic-wise Adaptive Metric (TEAM) framework for few-shot learning, by integrating the meta-learning paradigm with both deep metric learning and transductive inference. With exploring the pairwise constraints and regularization prior within each task, we explicitly formulate the adaptation procedure into a standard semi-definite programming problem. By solving the problem with its closed-form solution on the fly with the setup of transduction, our approach efficiently tailors an episodic-wise metric for each task to adapt all features from a shared task-agnostic embedding space into a more discriminative task-specific metric space. Moreover, we further leverage an attention-based bi-directional similarity strategy for extracting the more robust relationship between queries and prototypes. Extensive experiments on three benchmark datasets show that our framework is superior to other existing approaches and achieves the state-of-the-art performance in the few-shot literature.

READ FULL TEXT

page 3

page 8

research
01/26/2019

Few-shot Learning with Meta Metric Learners

Few-shot Learning aims to learn classifiers for new classes with only a ...
research
04/04/2019

A Hybrid Approach with Optimization and Metric-based Meta-Learner for Few-Shot Learning

Few-shot learning aims to learn classifiers for new classes with only a ...
research
05/21/2018

Meta-learning with differentiable closed-form solvers

Adapting deep networks to new concepts from few examples is extremely ch...
research
05/16/2019

TapNet: Neural Network Augmented with Task-Adaptive Projection for Few-Shot Learning

Handling previously unseen tasks after given only a few training example...
research
05/24/2018

Decision-Theoretic Meta-Learning: Versatile and Efficient Amortization of Few-Shot Learning

This paper develops a general framework for data efficient and versatile...
research
11/17/2018

Deep Comparison: Relation Columns for Few-Shot Learning

Few-shot deep learning is a topical challenge area for scaling visual re...
research
01/06/2023

Exploring Efficient Few-shot Adaptation for Vision Transformers

The task of Few-shot Learning (FSL) aims to do the inference on novel ca...

Please sign up or login with your details

Forgot password? Click here to reset