S2: An Efficient Graph Based Active Learning Algorithm with Application to Nonparametric Classification

06/29/2015
by   Gautam Dasarathy, et al.
0

This paper investigates the problem of active learning for binary label prediction on a graph. We introduce a simple and label-efficient algorithm called S2 for this task. At each step, S2 selects the vertex to be labeled based on the structure of the graph and all previously gathered labels. Specifically, S2 queries for the label of the vertex that bisects the *shortest shortest* path between any pair of oppositely labeled vertices. We present a theoretical estimate of the number of queries S2 needs in terms of a novel parametrization of the complexity of binary functions on graphs. We also present experimental results demonstrating the performance of S2 on both real and synthetic data. While other graph-based active learning algorithms have shown promise in practice, our algorithm is the first with both good performance and theoretical guarantees. Finally, we demonstrate the implications of the S2 algorithm to the theory of nonparametric active learning. In particular, we show that S2 achieves near minimax optimal excess risk for an important class of nonparametric classification problems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/15/2022

Active Learning with Neural Networks: Insights from Nonparametric Statistics

Deep neural networks have great representation power, but typically requ...
research
11/25/2018

HS^2: Active Learning over Hypergraphs

We propose a hypergraph-based active learning scheme which we term HS^2,...
research
02/03/2022

GALAXY: Graph-based Active Learning at the Extreme

Active learning is a label-efficient approach to train highly effective ...
research
05/17/2019

Graph-based Semi-Supervised & Active Learning for Edge Flows

We present a graph-based semi-supervised learning (SSL) method for learn...
research
09/28/2018

Target-Independent Active Learning via Distribution-Splitting

To reduce the label complexity in Agnostic Active Learning (A^2 algorith...
research
05/11/2023

Active Learning in the Predict-then-Optimize Framework: A Margin-Based Approach

We develop the first active learning method in the predict-then-optimize...
research
09/03/2016

Graph-Based Active Learning: A New Look at Expected Error Minimization

In graph-based active learning, algorithms based on expected error minim...

Please sign up or login with your details

Forgot password? Click here to reset