Active Transfer Learning with Zero-Shot Priors: Reusing Past Datasets for Future Tasks

10/06/2015
by   Efstratios Gavves, et al.
0

How can we reuse existing knowledge, in the form of available datasets, when solving a new and apparently unrelated target task from a set of unlabeled data? In this work we make a first contribution to answer this question in the context of image classification. We frame this quest as an active learning problem and use zero-shot classifiers to guide the learning process by linking the new task to the existing classifiers. By revisiting the dual formulation of adaptive SVM, we reveal two basic conditions to choose greedily only the most relevant samples to be annotated. On this basis we propose an effective active learning algorithm which learns the best possible target classification model with minimum human labeling effort. Extensive experiments on two challenging datasets show the value of our approach compared to the state-of-the-art active learning methodologies, as well as its potential to reuse past datasets with minimal effort for future tasks.

READ FULL TEXT

page 1

page 8

research
07/31/2020

Learning to Rank for Active Learning: A Listwise Approach

Active learning emerged as an alternative to alleviate the effort to lab...
research
12/16/2019

Incorporating Unlabeled Data into Distributionally Robust Learning

We study a robust alternative to empirical risk minimization called dist...
research
08/02/2016

Can Active Learning Experience Be Transferred?

Active learning is an important machine learning problem in reducing the...
research
09/23/2022

Active Few-Shot Classification: a New Paradigm for Data-Scarce Learning Settings

We consider a novel formulation of the problem of Active Few-Shot Classi...
research
11/21/2022

Can You Label Less by Using Out-of-Domain Data? Active Transfer Learning with Few-shot Instructions

Labeling social-media data for custom dimensions of toxicity and social ...
research
02/10/2018

Combinets: Learning New Classifiers via Recombination

Problems with few examples of a new class of objects prove challenging t...
research
02/14/2023

ScatterShot: Interactive In-context Example Curation for Text Transformation

The in-context learning capabilities of LLMs like GPT-3 allow annotators...

Please sign up or login with your details

Forgot password? Click here to reset