Improving Few-Shot Learning using Composite Rotation based Auxiliary Task

06/29/2020
by   Pratik Mazumder, et al.
0

In this paper, we propose an approach to improve few-shot classification performance using a composite rotation based auxiliary task. Few-shot classification methods aim to produce neural networks that perform well for classes with a large number of training samples and classes with less number of training samples. They employ techniques to enable the network to produce highly discriminative features that are also very generic. Generally, the better the quality and generic-nature of the features produced by the network, the better is the performance of the network on few-shot learning. Our approach aims to train networks to produce such features by using a self-supervised auxiliary task. Our proposed composite rotation based auxiliary task performs rotation at two levels, i.e., rotation of patches inside the image (inner rotation) and rotation of the whole image (outer rotation) and assigns one out of 16 rotation classes to the modified image. We then simultaneously train for the composite rotation prediction task along with the original classification task, which forces the network to learn high-quality generic features that help improve the few-shot classification performance. We experimentally show that our approach performs better than existing few-shot learning methods on multiple benchmark datasets.

READ FULL TEXT

page 2

page 4

page 8

research
01/24/2021

Improving Few-Shot Learning with Auxiliary Self-Supervised Pretext Tasks

Recent work on few-shot learning <cit.> showed that quality of learned r...
research
12/31/2019

Diversity Transfer Network for Few-Shot Learning

Few-shot learning is a challenging task that aims at training a classifi...
research
04/26/2023

ESPT: A Self-Supervised Episodic Spatial Pretext Task for Improving Few-Shot Learning

Self-supervised learning (SSL) techniques have recently been integrated ...
research
11/06/2022

Tuning Language Models as Training Data Generators for Augmentation-Enhanced Few-Shot Learning

Recent studies have revealed the intriguing few-shot learning ability of...
research
10/12/2022

Semantic Cross Attention for Few-shot Learning

Few-shot learning (FSL) has attracted considerable attention recently. A...
research
12/13/2020

Pseudo Shots: Few-Shot Learning with Auxiliary Data

In many practical few-shot learning problems, even though labeled exampl...
research
10/20/2020

Deep Low-Shot Learning for Biological Image Classification and Visualization from Limited Training Samples

Predictive modeling is useful but very challenging in biological image a...

Please sign up or login with your details

Forgot password? Click here to reset