Finding Task-Relevant Features for Few-Shot Learning by Category Traversal

05/27/2019
by   Hongyang Li, et al.
0

Few-shot learning is an important area of research. Conceptually, humans are readily able to understand new concepts given just a few examples, while in more pragmatic terms, limited-example training situations are common in practice. Recent effective approaches to few-shot learning employ a metric-learning framework to learn a feature similarity comparison between a query (test) example, and the few support (training) examples. However, these approaches treat each support class independently from one another, never looking at the entire task as a whole. Because of this, they are constrained to use a single set of features for all possible test-time tasks, which hinders the ability to distinguish the most relevant dimensions for the task at hand. In this work, we introduce a Category Traversal Module that can be inserted as a plug-and-play module into most metric-learning based few-shot learners. This component traverses across the entire support set at once, identifying task-relevant features based on both intra-class commonality and inter-class uniqueness in the feature space. Incorporating our module improves performance considerably (5 tieredImageNet benchmarks, with overall performance competitive with recent state-of-the-art systems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/24/2022

Adaptive Few-Shot Learning Algorithm for Rare Sound Event Detection

Sound event detection is to infer the event by understanding the surroun...
research
06/13/2016

Matching Networks for One Shot Learning

Learning from a few examples remains a key challenge in machine learning...
research
03/21/2022

HyperShot: Few-Shot Learning by Kernel HyperNetworks

Few-shot models aim at making predictions using a minimal number of labe...
research
11/30/2020

Multi-scale Adaptive Task Attention Network for Few-Shot Learning

The goal of few-shot learning is to classify unseen categories with few ...
research
07/07/2022

Diagnosing and Remedying Shot Sensitivity with Cosine Few-Shot Learners

Few-shot recognition involves training an image classifier to distinguis...
research
09/23/2020

Fuzzy Simplicial Networks: A Topology-Inspired Model to Improve Task Generalization in Few-shot Learning

Deep learning has shown great success in settings with massive amounts o...
research
11/01/2021

Few-shot learning with improved local representations via bias rectify module

Recent approaches based on metric learning have achieved great progress ...

Please sign up or login with your details

Forgot password? Click here to reset