Unbiased MLMC stochastic gradient-based optimization of Bayesian experimental designs

05/18/2020
by   Takashi Goda, et al.
23

In this paper we propose an efficient stochastic optimization algorithm to search for Bayesian experimental designs such that the expected information gain is maximized. The gradient of the expected information gain with respect to experimental design parameters is given by a nested expectation, for which the standard Monte Carlo method using a fixed number of inner samples yields a biased estimator. In this paper, applying the idea of randomized multilevel Monte Carlo methods, we introduce an unbiased Monte Carlo estimator for the gradient of the expected information gain with finite expected squared ℓ_2-norm and finite expected computational cost per sample. Our unbiased estimator can be combined well with stochastic gradient descent algorithms, which results in our proposal of an optimization algorithm to search for an optimal Bayesian experimental design. Numerical experiments confirm that our proposed algorithm works well not only for a simple test problem but also for a more realistic pharmacokinetic problem.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/04/2022

Constructing unbiased gradient estimators with finite variance for conditional stochastic optimization

We study stochastic gradient descent for solving conditional stochastic ...
research
08/19/2023

On Estimating the Gradient of the Expected Information Gain in Bayesian Experimental Design

Bayesian Experimental Design (BED), which aims to find the optimal exper...
research
11/01/2019

A Unified Stochastic Gradient Approach to Designing Bayesian-Optimal Experiments

We introduce a fully stochastic gradient based approach to Bayesian opti...
research
05/20/2022

Robust Expected Information Gain for Optimal Bayesian Experimental Design Using Ambiguity Sets

The ranking of experiments by expected information gain (EIG) in Bayesia...
research
06/27/2023

Stochastic Gradient Bayesian Optimal Experimental Designs for Simulation-based Inference

Simulation-based inference (SBI) methods tackle complex scientific model...
research
12/22/2020

Unbiased Gradient Estimation for Distributionally Robust Learning

Seeking to improve model generalization, we consider a new approach base...
research
04/11/2019

Bayesian optimal design using stochastic gradient optimisation and Fisher information gain

Finding high dimensional designs is increasingly important in applicatio...

Please sign up or login with your details

Forgot password? Click here to reset