Learning to Rank for Active Learning: A Listwise Approach

07/31/2020
by   Minghan Li, et al.
0

Active learning emerged as an alternative to alleviate the effort to label huge amount of data for data hungry applications (such as image/video indexing and retrieval, autonomous driving, etc.). The goal of active learning is to automatically select a number of unlabeled samples for annotation (according to a budget), based on an acquisition function, which indicates how valuable a sample is for training the model. The learning loss method is a task-agnostic approach which attaches a module to learn to predict the target loss of unlabeled data, and select data with the highest loss for labeling. In this work, we follow this strategy but we define the acquisition function as a learning to rank problem and rethink the structure of the loss prediction module, using a simple but effective listwise approach. Experimental results on four datasets demonstrate that our method outperforms recent state-of-the-art active learning approaches for both image classification and regression tasks.

READ FULL TEXT

page 1

page 7

research
05/09/2019

Learning Loss for Active Learning

The performance of deep neural networks improves with more annotated dat...
research
06/22/2021

MEAL: Manifold Embedding-based Active Learning

Image segmentation is a common and challenging task in autonomous drivin...
research
10/06/2015

Active Transfer Learning with Zero-Shot Priors: Reusing Past Datasets for Future Tasks

How can we reuse existing knowledge, in the form of available datasets, ...
research
12/09/2020

Cost-Based Budget Active Learning for Deep Learning

Majorly classical Active Learning (AL) approach usually uses statistical...
research
05/10/2022

ALLSH: Active Learning Guided by Local Sensitivity and Hardness

Active learning, which effectively collects informative unlabeled data f...
research
08/08/2018

Affect Estimation in 3D Space Using Multi-Task Active Learning for Regression

Acquisition of labeled training samples for affective computing is usual...
research
05/03/2023

Transfer and Active Learning for Dissonance Detection: Addressing the Rare-Class Challenge

While transformer-based systems have enabled greater accuracies with few...

Please sign up or login with your details

Forgot password? Click here to reset