Instance Credibility Inference for Few-Shot Learning

03/26/2020
by   Yikai Wang, et al.
5

Few-shot learning (FSL) aims to recognize new objects with extremely limited training data for each category. Previous efforts are made by either leveraging meta-learning paradigm or novel principles in data augmentation to alleviate this extremely data-scarce problem. In contrast, this paper presents a simple statistical approach, dubbed Instance Credibility Inference (ICI) to exploit the distribution support of unlabeled instances for few-shot learning. Specifically, we first train a linear classifier with the labeled few-shot examples and use it to infer the pseudo-labels for the unlabeled data. To measure the credibility of each pseudo-labeled instance, we then propose to solve another linear regression hypothesis by increasing the sparsity of the incidental parameters and rank the pseudo-labeled instances with their sparsity degree. We select the most trustworthy pseudo-labeled instances alongside the labeled examples to re-train the linear classifier. This process is iterated until all the unlabeled samples are included in the expanded training set, i.e. the pseudo-label is converged for unlabeled data pool. Extensive experiments under two few-shot settings show that our simple approach can establish new state-of-the-arts on four widely used few-shot learning benchmark datasets including miniImageNet, tieredImageNet, CIFAR-FS, and CUB. Our code is available at: https://github.com/Yikai-Wang/ICI-FSL

READ FULL TEXT
research
07/15/2020

How to trust unlabeled data? Instance Credibility Inference for Few-Shot Learning

Deep learning based models have excelled in many computer vision task an...
research
09/07/2021

Few-shot Learning via Dependency Maximization and Instance Discriminant Analysis

We study the few-shot learning (FSL) problem, where a model learns to re...
research
12/14/2020

Iterative label cleaning for transductive and semi-supervised few-shot learning

Few-shot learning amounts to learning representations and acquiring know...
research
07/26/2021

Transductive Maximum Margin Classifier for Few-Shot Learning

Few-shot learning aims to train a classifier that can generalize well wh...
research
01/05/2021

Local Propagation for Few-Shot Learning

The challenge in few-shot learning is that available data is not enough ...
research
10/18/2021

Who calls the shots? Rethinking Few-Shot Learning for Audio

Few-shot learning aims to train models that can recognize novel classes ...
research
11/19/2020

Hybrid Consistency Training with Prototype Adaptation for Few-Shot Learning

Few-Shot Learning (FSL) aims to improve a model's generalization capabil...

Please sign up or login with your details

Forgot password? Click here to reset