Metrics for Bayesian Optimal Experiment Design under Model Misspecification

04/17/2023
by   Tommie A. Catanach, et al.
0

The conventional approach to Bayesian decision-theoretic experiment design involves searching over possible experiments to select a design that maximizes the expected value of a specified utility function. The expectation is over the joint distribution of all unknown variables implied by the statistical model that will be used to analyze the collected data. The utility function defines the objective of the experiment where a common utility function is the information gain. This article introduces an expanded framework for this process, where we go beyond the traditional Expected Information Gain criteria and introduce the Expected General Information Gain which measures robustness to the model discrepancy and Expected Discriminatory Information as a criterion to quantify how well an experiment can detect model discrepancy. The functionality of the framework is showcased through its application to a scenario involving a linearized spring mass damper system and an F-16 model where the model discrepancy is taken into account while doing Bayesian optimal experiment design.

READ FULL TEXT
research
03/27/2013

The Effects of Perfect and Sample Information on Fuzzy Utilities in Decision-Making

In this paper, we first consider a Bayesian framework and model the "uti...
research
03/19/2023

Sequential Persuasion Using Limited Experiments

Bayesian persuasion and its derived information design problem has been ...
research
09/27/2019

Bayesian decision-theoretic design of experiments under an alternative model

Decision-theoretic Bayesian design of experiments is considered when the...
research
03/22/2023

Knowing what to know: Implications of the choice of prior distribution on the behavior of adaptive design optimization

Adaptive design optimization (ADO) is a state-of-the-art technique for e...
research
12/16/2019

Learning Arbitrary Quantities of Interest from Expensive Black-Box Functions through Bayesian Sequential Optimal Design

Estimating arbitrary quantities of interest (QoIs) that are non-linear o...
research
09/21/2021

Active inference, Bayesian optimal design, and expected utility

Active inference, a corollary of the free energy principle, is a formal ...
research
05/30/2015

Efficient Bayesian experimentation using an expected information gain lower bound

Experimental design is crucial for inference where limitations in the da...

Please sign up or login with your details

Forgot password? Click here to reset