Look-Ahead Acquisition Functions for Bernoulli Level Set Estimation

03/18/2022
by   Benjamin Letham, et al.
0

Level set estimation (LSE) is the problem of identifying regions where an unknown function takes values above or below a specified threshold. Active sampling strategies for efficient LSE have primarily been studied in continuous-valued functions. Motivated by applications in human psychophysics where common experimental designs produce binary responses, we study LSE active sampling with Bernoulli outcomes. With Gaussian process classification surrogate models, the look-ahead model posteriors used by state-of-the-art continuous-output methods are intractable. However, we derive analytic expressions for look-ahead posteriors of sublevel set membership, and show how these lead to analytic expressions for a class of look-ahead LSE acquisition functions, including information-based methods. Benchmark experiments show the importance of considering the global look-ahead impact on the entire posterior. We demonstrate a clear benefit to using this new class of acquisition functions on benchmark problems, and on a challenging real-world task of estimating a high-dimensional contrast sensitivity function.

READ FULL TEXT

page 7

page 20

research
07/21/2020

Efficient Graph-Based Active Learning with Probit Likelihood via Gaussian Approximations

We present a novel adaptation of active learning to graph-based semi-sup...
research
06/25/2022

Making Look-Ahead Active Learning Strategies Feasible with Neural Tangent Kernels

We propose a new method for approximating active learning acquisition st...
research
12/11/2018

R3-DLA (Reduce, Reuse, Recycle): A More Efficient Approach to Decoupled Look-Ahead Architectures

Modern societies have developed insatiable demands for more computation ...
research
07/04/2020

Playing Chess with Limited Look Ahead

We have seen numerous machine learning methods tackle the game of chess ...
research
12/17/2020

High Dimensional Level Set Estimation with Bayesian Neural Network

Level Set Estimation (LSE) is an important problem with applications in ...
research
06/01/2011

Conflict-Directed Backjumping Revisited

In recent years, many improvements to backtracking algorithms for solvin...
research
10/21/2015

GLASSES: Relieving The Myopia Of Bayesian Optimisation

We present GLASSES: Global optimisation with Look-Ahead through Stochast...

Please sign up or login with your details

Forgot password? Click here to reset