Bayesian model and dimension reduction for uncertainty propagation: applications in random media

11/07/2017
by   Constantin Grigo, et al.
0

Well-established methods for the solution of stochastic partial differential equations (SPDEs) typically struggle in problems with high-dimensional inputs/outputs. Such difficulties are only amplified in large-scale applications where even a few tens of full-order model runs are impractical. While dimensionality reduction can alleviate some of these issues, it is not known which and how many features of the (high-dimensional) input are actually predictive of the (high-dimensional) output. In this paper, we advocate a Bayesian formulation that is capable of performing simultaneous dimension and model-order reduction. It consists of a component that encodes the high-dimensional input into a low-dimensional set of feature functions by employing sparsity-enforcing priors and a decoding component that makes use of the solution of a coarse-grained model in order to reconstruct that of the full-order model. Both components are represented with latent variables in a probabilistic graphical model and are simultaneously trained using Stochastic Variational Inference methods. The model is capable of quantifying the predictive uncertainty due to the information loss that unavoidably takes place in any model-order/dimension reduction as well as the uncertainty arising from finite-sized training datasets. We demonstrate its capabilities in the context of random media where fine-scale fluctuations can give rise to random inputs with tens of thousands of variables. With a few tens of full-order model simulations, the proposed model is capable of identifying salient physical features and produce sharp predictions under different boundary conditions of the full output which itself consists of thousands of components.

READ FULL TEXT

page 18

page 21

page 22

page 23

research
02/11/2019

A physics-aware, probabilistic machine learning framework for coarse-graining high-dimensional systems in the Small Data regime

The automated construction of coarse-grained models represents a pivotal...
research
03/06/2017

Probabilistic Reduced-Order Modeling for Stochastic Partial Differential Equations

We discuss a Bayesian formulation to coarse-graining (CG) of PDEs where ...
research
02/09/2022

A survey of unsupervised learning methods for high-dimensional uncertainty quantification in black-box-type problems

Constructing surrogate models for uncertainty quantification (UQ) on com...
research
02/28/2022

Evaluating High-Order Predictive Distributions in Deep Learning

Most work on supervised learning research has focused on marginal predic...
research
11/21/2019

Computer Model Emulation with High-Dimensional Functional Output in Large-Scale Observing System Uncertainty Experiments

The observing system uncertainty experiments (OSUEs) have been widely us...
research
07/27/2022

Learning the Evolution of Correlated Stochastic Power System Dynamics

A machine learning technique is proposed for quantifying uncertainty in ...
research
05/26/2016

Predictive Coarse-Graining

We propose a data-driven, coarse-graining formulation in the context of ...

Please sign up or login with your details

Forgot password? Click here to reset