Active Learning from Weak and Strong Labelers

10/09/2015
by   Chicheng Zhang, et al.
0

An active learner is given a hypothesis class, a large set of unlabeled examples and the ability to interactively query labels to an oracle of a subset of these examples; the goal of the learner is to learn a hypothesis in the class that fits the data well by making as few label queries as possible. This work addresses active learning with labels obtained from strong and weak labelers, where in addition to the standard active learning setting, we have an extra weak labeler which may occasionally provide incorrect labels. An example is learning to classify medical images where either expensive labels may be obtained from a physician (oracle or strong labeler), or cheaper but occasionally incorrect labels may be obtained from a medical resident (weak labeler). Our goal is to learn a classifier with low error on data labeled by the oracle, while using the weak labeler to reduce the number of label queries made to this labeler. We provide an active learning algorithm for this setting, establish its statistical consistency, and analyze its label complexity to characterize when it can provide label savings over using the strong labeler alone.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/10/2014

Beyond Disagreement-based Agnostic Active Learning

We study agnostic active learning, where the goal is to learn a classifi...
research
11/04/2022

Improved Adaptive Algorithm for Scalable Active Learning with Weak Labeler

Active learning with strong and weak labelers considers a practical sett...
research
06/04/2021

Active Covering

We analyze the problem of active covering, where the learner is given an...
research
06/08/2015

Convergence Rates of Active Learning for Maximum Likelihood Estimation

An active learner is given a class of models, a large set of unlabeled e...
research
09/26/2013

Active Learning with Expert Advice

Conventional learning with expert advice methods assumes a learner is al...
research
09/08/2022

Active Learning of Classifiers with Label and Seed Queries

We study exact active learning of binary and multiclass classifiers with...
research
02/09/2021

Bounded Memory Active Learning through Enriched Queries

The explosive growth of easily-accessible unlabeled data has lead to gro...

Please sign up or login with your details

Forgot password? Click here to reset