Active Learning of Halfspaces under a Margin Assumption

12/07/2011
by   Alon Gonen, et al.
0

We derive and analyze a new, efficient, pool-based active learning algorithm for halfspaces, called ALuMA. Most previous algorithms show exponential improvement in the label complexity assuming that the distribution over the instance space is close to uniform. This assumption rarely holds in practical applications. Instead, we study the label complexity under a large-margin assumption -- a much more realistic condition, as evident by the success of margin-based algorithms such as SVM. Our algorithm is computationally efficient and comes with formal guarantees on its label complexity. It also naturally extends to the non-separable case and to non-linear kernels. Experiments illustrate the clear advantage of ALuMA over other active learning algorithms.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/31/2022

Efficient Active Learning with Abstention

The goal of active learning is to achieve the same accuracy achievable b...
research
05/07/2018

Efficient active learning of sparse halfspaces

We study the problem of efficient PAC active learning of homogeneous lin...
research
02/12/2020

Efficient active learning of sparse halfspaces with arbitrary bounded noise

In this work we study active learning of homogeneous s-sparse halfspaces...
research
04/05/2014

A Compression Technique for Analyzing Disagreement-Based Active Learning

We introduce a new and improved characterization of the label complexity...
research
05/31/2019

Minimum-Margin Active Learning

We present a new active sampling method we call min-margin which trains ...
research
01/31/2021

Exponential Savings in Agnostic Active Learning through Abstention

We show that in pool-based active classification without assumptions on ...
research
12/06/2019

A quantum active learning algorithm for sampling against adversarial attacks

Adversarial attacks represent a serious menace for learning algorithms a...

Please sign up or login with your details

Forgot password? Click here to reset