Bayesian Optimal Active Search and Surveying

by   Roman Garnett, et al.

We consider two active binary-classification problems with atypical objectives. In the first, active search, our goal is to actively uncover as many members of a given class as possible. In the second, active surveying, our goal is to actively query points to ultimately predict the proportion of a given class. Numerous real-world problems can be framed in these terms, and in either case typical model-based concerns such as generalization error are only of secondary importance. We approach these problems via Bayesian decision theory; after choosing natural utility functions, we derive the optimal policies. We provide three contributions. In addition to introducing the active surveying problem, we extend previous work on active search in two ways. First, we prove a novel theoretical result, that less-myopic approximations to the optimal policy can outperform more-myopic approximations by any arbitrary degree. We then derive bounds that for certain models allow us to reduce (in practice dramatically) the exponential search space required by a naive implementation of the optimal policy, enabling further lookahead while still ensuring that optimal decisions are always made.



There are no comments yet.


page 7


Efficient nonmyopic active search with applications in drug and materials discovery

Active search is a learning paradigm for actively identifying as many me...

Nonmyopic Multiclass Active Search for Diverse Discovery

Active search is a setting in adaptive experimental design where we aim ...

Nonmyopic Multifidelity Active Search

Active search is a learning paradigm where we seek to identify as many m...

Rényi Entropy Bounds on the Active Learning Cost-Performance Tradeoff

Semi-supervised classification, one of the most prominent fields in mach...

Active Sensing as Bayes-Optimal Sequential Decision Making

Sensory inference under conditions of uncertainty is a major problem in ...

Near Optimal Bayesian Active Learning for Decision Making

How should we gather information to make effective decisions? We address...

Learning Optimal Antenna Tilt Control Policies: A Contextual Linear Bandit Approach

Controlling antenna tilts in cellular networks is imperative to reach an...

Code Repositories


MATLAB code for performing active search (Garnett, et al., "Bayesian Optimal Active Search and Surveying," ICML 2012).

view repo
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.