Designing over uncertain outcomes with stochastic sampling Bayesian optimization

11/05/2019
by   Peter D. Tonner, et al.
26

Optimization is becoming increasingly common in scientific and engineering domains. Oftentimes, these problems involve various levels of stochasticity or uncertainty in generating proposed solutions. Therefore, optimization in these scenarios must consider this stochasticity to properly guide the design of future experiments. Here, we adapt Bayesian optimization to handle uncertain outcomes, proposing a new framework called stochastic sampling Bayesian optimization (SSBO). We show that the bounds on expected regret for an upper confidence bound search in SSBO resemble those of earlier Bayesian optimization approaches, with added penalties due to the stochastic generation of inputs. Additionally, we adapt existing batch optimization techniques to properly limit the myopic decision making that can arise when selecting multiple instances before feedback. Finally, we show that SSBO techniques properly optimize a set of standard optimization problems as well as an applied problem inspired by bioengineering.

READ FULL TEXT

page 17

page 18

page 20

page 21

research
11/04/2019

On Batch Bayesian Optimization

We present two algorithms for Bayesian optimization in the batch feedbac...
research
05/22/2018

Optimization, fast and slow: optimally switching between local and Bayesian optimization

We develop the first Bayesian Optimization algorithm, BLOSSOM, which sel...
research
08/01/2023

Hessian-Aware Bayesian Optimization for Decision Making Systems

Many approaches for optimizing decision making systems rely on gradient ...
research
06/15/2023

Distributionally Robust Stratified Sampling for Stochastic Simulations with Multiple Uncertain Input Models

This paper presents a robust version of the stratified sampling method w...
research
06/10/2019

Sampling Humans for Optimizing Preferences in Coloring Artwork

Many circumstances of practical importance have performance or success m...
research
11/16/2021

Bayesian Optimization for Cascade-type Multi-stage Processes

Complex processes in science and engineering are often formulated as mul...
research
08/16/2016

Fast Calculation of the Knowledge Gradient for Optimization of Deterministic Engineering Simulations

A novel efficient method for computing the Knowledge-Gradient policy for...

Please sign up or login with your details

Forgot password? Click here to reset