Bayesian Active Learning With Abstention Feedbacks

06/04/2019
by   Cuong V. Nguyen, et al.
0

We study pool-based active learning with abstention feedbacks where a labeler can abstain from labeling a queried example with some unknown abstention rate. Using the Bayesian approach, we develop two new greedy algorithms that learn both the classification problem and the unknown abstention rate at the same time. These are achieved by incorporating the estimated average abstention rate into the greedy criteria. We prove that both algorithms have near-optimality guarantees: they respectively achieve a (1-1/e) constant factor approximation of the optimal expected or worst-case value of a useful utility function. Our experiments show the algorithms perform well in various practical scenarios.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/23/2017

Bayesian Pool-based Active Learning With Abstention Feedbacks

We study pool-based active learning with abstention feedbacks, where a l...
research
03/30/2016

Robustness of Bayesian Pool-based Active Learning Against Prior Misspecification

We study the robustness of active learning (AL) algorithms against prior...
research
10/15/2010

Near-Optimal Bayesian Active Learning with Noisy Observations

We tackle the fundamental problem of Bayesian active learning with noise...
research
06/01/2019

Active Learning for Binary Classification with Abstention

We construct and analyze active learning algorithms for the problem of b...
research
09/17/2012

Submodularity in Batch Active Learning and Survey Problems on Gaussian Random Fields

Many real-world datasets can be represented in the form of a graph whose...
research
02/23/2016

Submodular Learning and Covering with Response-Dependent Costs

We consider interactive learning and covering problems, in a setting whe...
research
11/04/2017

Approximate Supermodularity Bounds for Experimental Design

This work provides performance guarantees for the greedy solution of exp...

Please sign up or login with your details

Forgot password? Click here to reset