Bayesian Generative Active Deep Learning

04/26/2019
by   Toan Tran, et al.
0

Deep learning models have demonstrated outstanding performance in several problems, but their training process tends to require immense amounts of computational and human resources for training and labeling, constraining the types of problems that can be tackled. Therefore, the design of effective training methods that require small labeled training sets is an important research direction that will allow a more effective use of resources.Among current approaches designed to address this issue, two are particularly interesting: data augmentation and active learning. Data augmentation achieves this goal by artificially generating new training points, while active learning relies on the selection of the "most informative" subset of unlabeled training samples to be labelled by an oracle. Although successful in practice, data augmentation can waste computational resources because it indiscriminately generates samples that are not guaranteed to be informative, and active learning selects a small subset of informative samples (from a large un-annotated set) that may be insufficient for the training process. In this paper, we propose a Bayesian generative active deep learning approach that combines active learning with data augmentation -- we provide theoretical and empirical evidence (MNIST, CIFAR-{10,100}, and SVHN) that our approach has more efficient training and better classification results than data augmentation and active learning.

READ FULL TEXT
research
10/29/2017

A Bayesian Data Augmentation Approach for Learning Deep Models

Data augmentation is an essential part of the training process applied t...
research
12/20/2019

Adversarial Representation Active Learning

Active learning aims to develop label-efficient algorithms by querying t...
research
11/09/2020

LADA: Look-Ahead Data Acquisition via Augmentation for Active Learning

Active learning effectively collects data instances for training deep le...
research
10/16/2021

Deep Active Learning by Leveraging Training Dynamics

Active learning theories and methods have been extensively studied in cl...
research
05/17/2019

Galaxy Zoo: Probabilistic Morphology through Bayesian CNNs and Active Learning

We use Bayesian convolutional neural networks and a novel generative mod...
research
07/25/2022

Efficient Classification with Counterfactual Reasoning and Active Learning

Data augmentation is one of the most successful techniques to improve th...
research
02/06/2022

LiDAR dataset distillation within bayesian active learning framework: Understanding the effect of data augmentation

Autonomous driving (AD) datasets have progressively grown in size in the...

Please sign up or login with your details

Forgot password? Click here to reset