A Bayesian Nonparametric Framework for Uncertainty Quantification in Simulation

10/09/2019
by   Wei Xie, et al.
0

When we use simulation to assess the performance of stochastic systems, the input models used to drive simulation experiments are often estimated from finite real-world data. There exist both input and simulation estimation uncertainty in the system performance estimates. Without strong prior information on the input models and the system mean response surface, in this paper, we propose a Bayesian nonparametric framework to quantify the impact from both sources of uncertainty. Specifically, nonparametric input models are introduced to faithfully capture the important features of the real-world data, such as heterogeneity, multi-modality and skewness. Bayesian posteriors of flexible input models characterize the input uncertainty, which automatically accounts for both model selection and parameter value uncertainty. Then, the input uncertainty is propagated to outputs by using direct simulation. Thus, under very general conditions, our framework delivers an empirical credible interval accounting for both input and simulation uncertainties. A variance decomposition is further developed to quantify the relative contributions from both sources of uncertainty. Our approach is supported by rigorous theoretical and empirical study.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/09/2020

Statistical Uncertainty Analysis for Stochastic Simulation

When we use simulation to evaluate the performance of a stochastic syste...
research
11/11/2019

Accurate Uncertainty Estimation and Decomposition in Ensemble Learning

Ensemble learning is a standard approach to building machine learning sy...
research
03/16/2022

Stochastic Simulation Uncertainty Analysis to Accelerate Flexible Biomanufacturing Process Development

Motivated by critical challenges and needs from biopharmaceuticals manuf...
research
04/30/2019

A guide to Value of Information methods for prioritising research in health impact modelling

Health impact simulation models are used to predict how a proposed inter...
research
11/11/2018

Subsampling to Enhance Efficiency in Input Uncertainty Quantification

In stochastic simulation, input uncertainty refers to the output variabi...
research
12/24/2019

Online Quantification of Input Model Uncertainty by Two-Layer Importance Sampling

Stochastic simulation has been widely used to analyze the performance of...
research
01/19/2021

Sequential Bayesian Risk Set Inference for Robust Discrete Optimization via Simulation

Optimization via simulation (OvS) procedures that assume the simulation ...

Please sign up or login with your details

Forgot password? Click here to reset