Efficient Bayesian experimentation using an expected information gain lower bound

05/30/2015
by   Panagiotis Tsilifis, et al.
0

Experimental design is crucial for inference where limitations in the data collection procedure are present due to cost or other restrictions. Optimal experimental designs determine parameters that in some appropriate sense make the data the most informative possible. In a Bayesian setting this is translated to updating to the best possible posterior. Information theoretic arguments have led to the formation of the expected information gain as a design criterion. This can be evaluated mainly by Monte Carlo sampling and maximized by using stochastic approximation methods, both known for being computationally expensive tasks. We propose a framework where a lower bound of the expected information gain is used as an alternative design criterion. In addition to alleviating the computational burden, this also addresses issues concerning estimation bias. The problem of permeability inference in a large contaminated area is used to demonstrate the validity of our approach where we employ the massively parallel version of the multiphase multicomponent simulator TOUGH2 to simulate contaminant transport and a Polynomial Chaos approximation of the forward model that further accelerates the objective function evaluations. The proposed methodology is demonstrated to a setting where field measurements are available.

READ FULL TEXT

page 3

page 11

page 13

page 23

page 25

research
08/20/2011

Simulation-based optimal Bayesian experimental design for nonlinear systems

The optimal selection of experimental conditions is essential to maximiz...
research
04/01/2020

An approximate KLD based experimental design for models with intractable likelihoods

Data collection is a critical step in statistical inference and data sci...
research
08/10/2020

Optimal Bayesian experimental design for subsurface flow problems

Optimal Bayesian design techniques provide an estimate for the best para...
research
01/22/2020

Bayesian design for minimising uncertainty in spatial processes

Model-based geostatistical design involves the selection of locations to...
research
04/17/2023

Metrics for Bayesian Optimal Experiment Design under Model Misspecification

The conventional approach to Bayesian decision-theoretic experiment desi...
research
10/07/2022

Design Amortization for Bayesian Optimal Experimental Design

Bayesian optimal experimental design is a sub-field of statistics focuse...
research
05/31/2021

Active Learning of Continuous-time Bayesian Networks through Interventions

We consider the problem of learning structures and parameters of Continu...

Please sign up or login with your details

Forgot password? Click here to reset