Simultaneous Perturbation Stochastic Approximation for Few-Shot Learning

06/09/2020
by   Andrei Boiarov, et al.
25

Few-shot learning is an important research field of machine learning in which a classifier must be trained in such a way that it can adapt to new classes which are not included in the training set. However, only small amounts of examples of each class are available for training. This is one of the key problems with learning algorithms of this type which leads to the significant uncertainty. We attack this problem via randomized stochastic approximation. In this paper, we suggest to consider the new multi-task loss function and propose the SPSA-like few-shot learning approach based on the prototypical networks method. We provide a theoretical justification and an analysis of experiments for this approach. The results of experiments on the benchmark dataset demonstrate that the proposed method is superior to the original prototypical networks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/28/2021

One-shot Learning with Absolute Generalization

One-shot learning is proposed to make a pretrained classifier workable o...
research
10/25/2021

Multi-Task Meta-Learning Modification with Stochastic Approximation

Meta-learning methods aim to build learning algorithms capable of quickl...
research
10/01/2022

Offline Handwritten Amharic Character Recognition Using Few-shot Learning

Few-shot learning is an important, but challenging problem of machine le...
research
05/24/2019

Learning to learn by Self-Critique

In few-shot learning, a machine learning system learns from a small set ...
research
05/22/2020

One of these (Few) Things is Not Like the Others

To perform well, most deep learning based image classification systems r...
research
09/28/2022

Revisiting Few-Shot Learning from a Causal Perspective

Few-shot learning with N-way K-shot scheme is an open challenge in machi...
research
08/22/2017

Dynamic Input Structure and Network Assembly for Few-Shot Learning

The ability to learn from a small number of examples has been a difficul...

Please sign up or login with your details

Forgot password? Click here to reset