Parameter Estimation with Maximal Updated Densities

12/08/2022
by   Michael Pilosov, et al.
0

A recently developed measure-theoretic framework solves a stochastic inverse problem (SIP) for models where uncertainties in model output data are predominantly due to aleatoric (i.e., irreducible) uncertainties in model inputs (i.e., parameters). The subsequent inferential target is a distribution on parameters. Another type of inverse problem is to quantify uncertainties in estimates of "true" parameter values under the assumption that such uncertainties should be reduced as more data are incorporated into the problem, i.e., the uncertainty is considered epistemic. A major contribution of this work is the formulation and solution of such a parameter identification problem (PIP) within the measure-theoretic framework developed for the SIP. The approach is novel in that it utilizes a solution to a stochastic forward problem (SFP) to update an initial density only in the parameter directions informed by the model output data. In other words, this method performs "selective regularization" only in the parameter directions not informed by data. The solution is defined by a maximal updated density (MUD) point where the updated density defines the measure-theoretic solution to the PIP. Another significant contribution of this work is the full theory of existence and uniqueness of MUD points for linear maps with Gaussian distributions. Data-constructed Quantity of Interest (QoI) maps are also presented and analyzed for solving the PIP within this measure-theoretic framework as a means of reducing uncertainties in the MUD estimate. We conclude with a demonstration of the general applicability of the method on two problems involving either spatial or temporal data for estimating uncertain model parameters.

READ FULL TEXT

page 21

page 24

research
10/11/2020

Real-time parameter inference in reduced-order flame models with heteroscedastic Bayesian neural network ensembles

The estimation of model parameters with uncertainties from observed data...
research
04/04/2023

Global Identifiability Analysis of Statistical Models using an Information-Theoretic Estimator in a Bayesian Framework

An information-theoretic estimator is proposed to assess the global iden...
research
07/23/2023

Information-theoretic Analysis of Test Data Sensitivity in Uncertainty

Bayesian inference is often utilized for uncertainty quantification task...
research
02/09/2023

Analysing the SEDs of protoplanetary disks with machine learning

ABRIDGED. The analysis of spectral energy distributions (SEDs) of protop...
research
03/27/2013

Estimating Uncertain Spatial Relationships in Robotics

In this paper, we describe a representation for spatial information, cal...
research
08/25/2023

Bayesian Reasoning for Physics Informed Neural Networks

Physics informed neural network (PINN) approach in Bayesian formulation ...
research
02/22/2021

Sequential Bayesian experimental design for estimation of extreme-event probability in stochastic dynamical systems

We consider a dynamical system with two sources of uncertainties: (1) pa...

Please sign up or login with your details

Forgot password? Click here to reset