Active Few-Shot Classification: a New Paradigm for Data-Scarce Learning Settings

09/23/2022
by   Aymane Abdali, et al.
0

We consider a novel formulation of the problem of Active Few-Shot Classification (AFSC) where the objective is to classify a small, initially unlabeled, dataset given a very restrained labeling budget. This problem can be seen as a rival paradigm to classical Transductive Few-Shot Classification (TFSC), as both these approaches are applicable in similar conditions. We first propose a methodology that combines statistical inference, and an original two-tier active learning strategy that fits well into this framework. We then adapt several standard vision benchmarks from the field of TFSC. Our experiments show the potential benefits of AFSC can be substantial, with gains in average weighted accuracy of up to 10 methods for the same labeling budget. We believe this new paradigm could lead to new developments and standards in data-scarce learning settings.

READ FULL TEXT
research
10/22/2021

A Simple Baseline for Low-Budget Active Learning

Active learning focuses on choosing a subset of unlabeled data to be lab...
research
05/17/2018

Single Shot Active Learning using Pseudo Annotators

Standard myopic active learning assumes that human annotations are alway...
research
10/06/2015

Active Transfer Learning with Zero-Shot Priors: Reusing Past Datasets for Future Tasks

How can we reuse existing knowledge, in the form of available datasets, ...
research
04/15/2021

Adaptive Active Learning for Coreference Resolution

Training coreference resolution models require comprehensively labeled d...
research
06/11/2021

Nonmyopic Multifidelity Active Search

Active search is a learning paradigm where we seek to identify as many m...
research
12/21/2021

Practical Active Learning with Model Selection for Small Data

Active learning is of great interest for many practical applications, es...
research
02/09/2022

Can Humans Do Less-Than-One-Shot Learning?

Being able to learn from small amounts of data is a key characteristic o...

Please sign up or login with your details

Forgot password? Click here to reset