Task-Aware Variational Adversarial Active Learning

02/11/2020
by   Kwanyoung Kim, et al.
0

Deep learning has achieved remarkable performance in various tasks thanks to massive labeled datasets. However, there are often cases where labeling large amount of data is challenging or infeasible due to high labeling cost such as labeling by experts or long labeling time per large-scale data sample (e.g., video, very large image). Active learning is one of the ways to query the most informative samples to be annotated among massive unlabeled pool. Two promising directions for active learning that have been recently explored are data distribution-based approach to select data points that are far from current labeled pool and model uncertainty-based approach that relies on the perspective of task model. Unfortunately, the former does not exploit structures from tasks and the latter does not seem to well-utilize overall data distribution. Here, we propose the methods that simultaneously take advantage of both data distribution and model uncertainty approaches. Our proposed methods exploit variational adversarial active learning (VAAL), that considered data distribution of both label and unlabeled pools, by incorporating learning loss prediction module and RankCGAN concept into VAAL by modeling loss prediction as a ranker. We demonstrate that our proposed methods outperform recent state-of-the-art active learning methods on various balanced and imbalanced benchmark datasets.

READ FULL TEXT
research
06/22/2021

Active Learning under Pool Set Distribution Shift and Noisy Data

Active Learning is essential for more label-efficient deep learning. Bay...
research
07/25/2023

Robust Assignment of Labels for Active Learning with Sparse and Noisy Annotations

Supervised classification algorithms are used to solve a growing number ...
research
01/28/2022

Dominant Set-based Active Learning for Text Classification and its Application to Online Social Media

Recent advances in natural language processing (NLP) in online social me...
research
02/24/2021

Active Learning to Classify Macromolecular Structures in situ for Less Supervision in Cryo-Electron Tomography

Motivation: Cryo-Electron Tomography (cryo-ET) is a 3D bioimaging tool t...
research
12/09/2020

Cost-Based Budget Active Learning for Deep Learning

Majorly classical Active Learning (AL) approach usually uses statistical...
research
10/21/2019

Mining GOLD Samples for Conditional GANs

Conditional generative adversarial networks (cGANs) have gained a consid...
research
05/13/2023

An Active Learning-based Approach for Hosting Capacity Analysis in Distribution Systems

With the increasing amount of distributed energy resources (DERs) integr...

Please sign up or login with your details

Forgot password? Click here to reset