Optimal Design of Validation Experiments for the Prediction of Quantities of Interest

Numerical predictions of quantities of interest measured within physical systems rely on the use of mathematical models that should be validated, or at best, not invalidated. Model validation usually involves the comparison of experimental data (outputs from the system of interest) and model predictions, both obtained at a specific validation scenario. The design of this validation experiment should be directly relevant to the objective of the model, that of predicting a quantity of interest at a prediction scenario. In this paper, we address two specific issues arising when designing validation experiments. The first issue consists in determining an appropriate validation scenario in cases where the prediction scenario cannot be carried out in a controlled environment. The second issue concerns the selection of observations when the quantity of interest cannot be readily observed. The proposed methodology involves the computation of influence matrices that characterize the response surface of given model functionals. Minimization of the distance between influence matrices allow one for selecting a validation experiment most representative of the prediction scenario. We illustrate our approach on two numerical examples. The first example considers the validation of a simple model based on an ordinary differential equation governing an object in free fall to put in evidence the importance of the choice of the validation experiment. The second numerical experiment focuses on the transport of a pollutant and demonstrates the impact that the choice of the quantity of interest has on the validation experiment to be performed.

READ FULL TEXT

page 22

page 24

research
11/26/2020

Development and Realization of Validation Benchmarks

In the field of modeling, the word validation refers to simple compariso...
research
02/20/2018

A Learning Based Approach for Uncertainty Analysis in Numerical Weather Prediction Models

Complex numerical weather prediction models incorporate a variety of phy...
research
04/21/2023

KitchenScale: Learning to predict ingredient quantities from recipe contexts

Determining proper quantities for ingredients is an essential part of co...
research
09/13/2020

Optimal Bounds on Nonlinear Partial Differential Equations in Model Certification, Validation, and Experimental Design

We demonstrate that the recently developed Optimal Uncertainty Quantific...
research
11/20/2018

Global sensitivity analysis for models described by stochastic differential equations

Many mathematical models involve input parameters, which are not precise...
research
01/17/2017

The Method of Arbitrarily Large Moments to Calculate Single Scale Processes in Quantum Field Theory

We device a new method to calculate a large number of Mellin moments of ...
research
06/05/2018

The Value of Information in Retrospect

In the course of any statistical analysis, it is necessary to consider i...

Please sign up or login with your details

Forgot password? Click here to reset