Streaming Active Learning with Deep Neural Networks

03/05/2023
by   Akanksha Saran, et al.
0

Active learning is perhaps most naturally posed as an online learning problem. However, prior active learning approaches with deep neural networks assume offline access to the entire dataset ahead of time. This paper proposes VeSSAL, a new algorithm for batch active learning with deep neural networks in streaming settings, which samples groups of points to query for labels at the moment they are encountered. Our approach trades off between uncertainty and diversity of queried samples to match a desired query rate without requiring any hand-tuned hyperparameters. Altogether, we expand the applicability of deep neural networks to realistic active learning scenarios, such as applications relevant to HCI and large, fractured datasets.

READ FULL TEXT

page 7

page 9

research
06/09/2019

Deep Batch Active Learning by Diverse, Uncertain Gradient Lower Bounds

We design a new algorithm for batch active learning with deep neural net...
research
11/19/2018

Deep Active Learning with a Neural Architecture Search

We consider active learning of deep neural networks. Most active learnin...
research
11/20/2019

Deep Active Learning: Unified and Principled Method for Query and Training

In this paper, we proposed a unified and principled method for both quer...
research
11/04/2022

Improved Adaptive Algorithm for Scalable Active Learning with Weak Labeler

Active learning with strong and weak labelers considers a practical sett...
research
08/28/2023

Distributionally Robust Statistical Verification with Imprecise Neural Networks

A particularly challenging problem in AI safety is providing guarantees ...
research
06/22/2020

Effective Version Space Reduction for Convolutional Neural Networks

In active learning, sampling bias could pose a serious inconsistency pro...
research
10/16/2021

Deep Active Learning by Leveraging Training Dynamics

Active learning theories and methods have been extensively studied in cl...

Please sign up or login with your details

Forgot password? Click here to reset