Adversarial Representation Active Learning

12/20/2019
by   Ali Mottaghi, et al.
44

Active learning aims to develop label-efficient algorithms by querying the most informative samples to be labeled by an oracle. The design of efficient training methods that require fewer labels is an important research direction that allows more effective use of computational and human resources for labeling and training deep neural networks. In this work, we demonstrate how we can use recent advances in deep generative models, to outperform the state-of-the-art in achieving the highest classification accuracy using as few labels as possible. Unlike previous approaches, our approach uses not only labeled images to train the classifier but also unlabeled images and generated images for co-training the whole model. Our experiments show that the proposed method significantly outperforms existing approaches in active learning on a wide range of datasets (MNIST, CIFAR-10, SVHN, CelebA, and ImageNet).

READ FULL TEXT

page 4

page 6

research
04/26/2019

Bayesian Generative Active Deep Learning

Deep learning models have demonstrated outstanding performance in severa...
research
03/23/2020

Diffusion-based Deep Active Learning

The remarkable performance of deep neural networks depends on the availa...
research
10/27/2019

Prediction stability as a criterion in active learning

Recent breakthroughs made by deep learning rely heavily on large number ...
research
08/01/2017

Active Learning for Convolutional Neural Networks: A Core-Set Approach

Convolutional neural networks (CNNs) have been successfully applied to m...
research
11/08/2018

Large-Scale Visual Active Learning with Deep Probabilistic Ensembles

Annotating the right data for training deep neural networks is an import...
research
05/17/2019

Galaxy Zoo: Probabilistic Morphology through Bayesian CNNs and Active Learning

We use Bayesian convolutional neural networks and a novel generative mod...
research
10/29/2020

PAL : Pretext-based Active Learning

When obtaining labels is expensive, the requirement of a large labeled t...

Please sign up or login with your details

Forgot password? Click here to reset