Bayesian Optimal Active Search and Surveying

06/27/2012
by   Roman Garnett, et al.
0

We consider two active binary-classification problems with atypical objectives. In the first, active search, our goal is to actively uncover as many members of a given class as possible. In the second, active surveying, our goal is to actively query points to ultimately predict the proportion of a given class. Numerous real-world problems can be framed in these terms, and in either case typical model-based concerns such as generalization error are only of secondary importance. We approach these problems via Bayesian decision theory; after choosing natural utility functions, we derive the optimal policies. We provide three contributions. In addition to introducing the active surveying problem, we extend previous work on active search in two ways. First, we prove a novel theoretical result, that less-myopic approximations to the optimal policy can outperform more-myopic approximations by any arbitrary degree. We then derive bounds that for certain models allow us to reduce (in practice dramatically) the exponential search space required by a naive implementation of the optimal policy, enabling further lookahead while still ensuring that optimal decisions are always made.

READ FULL TEXT
research
11/21/2018

Efficient nonmyopic active search with applications in drug and materials discovery

Active search is a learning paradigm for actively identifying as many me...
research
02/08/2022

Nonmyopic Multiclass Active Search for Diverse Discovery

Active search is a setting in adaptive experimental design where we aim ...
research
06/11/2021

Nonmyopic Multifidelity Active Search

Active search is a learning paradigm where we seek to identify as many m...
research
02/05/2020

Rényi Entropy Bounds on the Active Learning Cost-Performance Tradeoff

Semi-supervised classification, one of the most prominent fields in mach...
research
08/09/2014

Active Sensing as Bayes-Optimal Sequential Decision Making

Sensory inference under conditions of uncertainty is a major problem in ...
research
02/24/2014

Near Optimal Bayesian Active Learning for Decision Making

How should we gather information to make effective decisions? We address...
research
09/06/2022

Efficient search of active inference policy spaces using k-means

We develop an approach to policy selection in active inference that allo...

Please sign up or login with your details

Forgot password? Click here to reset