Training few-shot classification via the perspective of minibatch and pretraining

04/10/2020
by   Meiyu Huang, et al.
15

Few-shot classification is a challenging task which aims to formulate the ability of humans to learn concepts from limited prior data and has drawn considerable attention in machine learning. Recent progress in few-shot classification has featured meta-learning, in which a parameterized model for a learning algorithm is defined and trained to learn the ability of handling classification tasks on extremely large or infinite episodes representing different classification task, each with a small labeled support set and its corresponding query set. In this work, we advance this few-shot classification paradigm by formulating it as a supervised classification learning problem. We further propose multi-episode and cross-way training techniques, which respectively correspond to the minibatch and pretraining in classification problems. Experimental results on a state-of-the-art few-shot classification method (prototypical networks) demonstrate that both the proposed training strategies can highly accelerate the training process without accuracy loss for varying few-shot classification problems on Omniglot and miniImageNet.

READ FULL TEXT
research
03/02/2018

Meta-Learning for Semi-Supervised Few-Shot Classification

In few-shot classification, we are interested in learning algorithms tha...
research
09/11/2020

Meta Learning for Few-Shot One-class Classification

We propose a method that can perform one-class classification given only...
research
09/25/2019

A Theoretical Analysis of the Number of Shots in Few-Shot Learning

Few-shot classification is the task of predicting the category of an exa...
research
10/13/2022

Few-shot Relational Reasoning via Connection Subgraph Pretraining

Few-shot knowledge graph (KG) completion task aims to perform inductive ...
research
05/03/2020

How Can We Accelerate Progress Towards Human-like Linguistic Generalization?

This position paper describes and critiques the Pretraining-Agnostic Ide...
research
04/21/2023

Shot Optimization in Quantum Machine Learning Architectures to Accelerate Training

In this paper, we propose shot optimization method for QML models at the...
research
10/12/2022

The Devil is in the Details: On Models and Training Regimes for Few-Shot Intent Classification

Few-shot Intent Classification (FSIC) is one of the key challenges in mo...

Please sign up or login with your details

Forgot password? Click here to reset