Gradient-based Bayesian Experimental Design for Implicit Models using Mutual Information Lower Bounds

05/10/2021
by   Steven Kleinegesse, et al.
0

We introduce a framework for Bayesian experimental design (BED) with implicit models, where the data-generating distribution is intractable but sampling from it is still possible. In order to find optimal experimental designs for such models, our approach maximises mutual information lower bounds that are parametrised by neural networks. By training a neural network on sampled data, we simultaneously update network parameters and designs using stochastic gradient-ascent. The framework enables experimental design with a variety of prominent lower bounds and can be applied to a wide range of scientific tasks, such as parameter estimation, model discrimination and improving future predictions. Using a set of intractable toy models, we provide a comprehensive empirical comparison of prominent lower bounds applied to the aforementioned tasks. We further validate our framework on a challenging system of stochastic differential equations from epidemiology.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/19/2020

Bayesian Experimental Design for Implicit Models by Mutual Information Neural Estimation

Implicit stochastic models, where the data-generation distribution is in...
research
03/20/2020

Sequential Bayesian Experimental Design for Implicit Models via Mutual Information

Bayesian experimental design (BED) is a framework that uses statistical ...
research
06/27/2023

Stochastic Gradient Bayesian Optimal Experimental Designs for Simulation-based Inference

Simulation-based inference (SBI) methods tackle complex scientific model...
research
02/05/2022

Lower-bounds on the Bayesian Risk in Estimation Procedures via f-Divergences

We consider the problem of parameter estimation in a Bayesian setting an...
research
03/14/2021

A Scalable Gradient-Free Method for Bayesian Experimental Design with Implicit Models

Bayesian experimental design (BED) is to answer the question that how to...
research
03/14/2021

A Hybrid Gradient Method to Designing Bayesian Experiments for Implicit Models

Bayesian experimental design (BED) aims at designing an experiment to ma...
research
05/21/2021

Certification of Iterative Predictions in Bayesian Neural Networks

We consider the problem of computing reach-avoid probabilities for itera...

Please sign up or login with your details

Forgot password? Click here to reset