The Effectiveness of Variational Autoencoders for Active Learning

The high cost of acquiring labels is one of the main challenges in deploying supervised machine learning algorithms. Active learning is a promising approach to control the learning process and address the difficulties of data labeling by selecting labeled training examples from a large pool of unlabeled instances. In this paper, we propose a new data-driven approach to active learning by choosing a small set of labeled data points that are both informative and representative. To this end, we present an efficient geometric technique to select a diverse core-set in a low-dimensional latent space obtained by training a Variational Autoencoder (VAE). Our experiments demonstrate an improvement in accuracy over two related techniques and, more importantly, signify the representation power of generative modeling for developing new active learning methods in high-dimensional data settings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/31/2019

Variational Adversarial Active Learning

Active learning aims to develop label-efficient algorithms by sampling t...
research
03/25/2023

Deep Kernel Methods Learn Better: From Cards to Process Optimization

The ability of deep learning methods to perform classification and regre...
research
12/06/2018

Active Learning Methods based on Statistical Leverage Scores

In many real-world machine learning applications, unlabeled data are abu...
research
11/21/2018

Robust Active Learning for Electrocardiographic Signal Classification

The classification of electrocardiographic (ECG) signals is a challengin...
research
10/27/2020

Graph-based Reinforcement Learning for Active Learning in Real Time: An Application in Modeling River Networks

Effective training of advanced ML models requires large amounts of label...
research
06/05/2021

Low Budget Active Learning via Wasserstein Distance: An Integer Programming Approach

Given restrictions on the availability of data, active learning is the p...
research
08/15/2023

BI-LAVA: Biocuration with Hierarchical Image Labeling through Active Learning and Visual Analysis

In the biomedical domain, taxonomies organize the acquisition modalities...

Please sign up or login with your details

Forgot password? Click here to reset