A Fully Bayesian Gradient-Free Supervised Dimension Reduction Method using Gaussian Processes

08/08/2020
by   Raphael Gautier, et al.
19

Modern day engineering problems are ubiquitously characterized by sophisticated computer codes that map parameters or inputs to an underlying physical process. In other situations, experimental setups are used to model the physical process in a laboratory, ensuring high precision while being costly in materials and logistics. In both scenarios, only limited amount of data can be generated by querying the expensive information source at a finite number of inputs or designs. This problem is compounded further in the presence of a high-dimensional input space. State-of-the-art parameter space dimension reduction methods, such as active subspace, aim to identify a subspace of the original input space that is sufficient to explain the output response. These methods are restricted by their reliance on gradient evaluations or copious data, making them inadequate to expensive problems without direct access to gradients. The proposed methodology is gradient-free and fully Bayesian, as it quantifies uncertainty in both the low-dimensional subspace and the surrogate model parameters. This enables a full quantification of epistemic uncertainty and robustness to limited data availability. It is validated on multiple datasets from engineering and science and compared to two other state-of-the-art methods based on four aspects: a) recovery of the active subspace, b) deterministic prediction accuracy, c) probabilistic prediction accuracy, and d) training time. The comparison shows that the proposed method improves the active subspace recovery and predictive accuracy, in both the deterministic and probabilistic sense, when only few model observations are available for training, at the cost of increased training time.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/22/2020

Structure exploiting methods for fast uncertainty quantification in multiphase flow through heterogeneous media

We present a computational framework for dimension reduction and surroga...
research
02/27/2019

Deep active subspaces -- a scalable method for high-dimensional uncertainty propagation

A problem of considerable importance within the field of uncertainty qua...
research
03/10/2019

Uncertainty Propagation in Deep Neural Network Using Active Subspace

The inputs of deep neural network (DNN) from real-world data usually com...
research
10/27/2021

Multi-fidelity data fusion through parameter space reduction with applications to automotive engineering

Multi-fidelity models are of great importance due to their capability of...
research
02/07/2018

Dimension Reduction Using Active Manifolds

Scientists and engineers rely on accurate mathematical models to quantif...
research
10/29/2019

Active Subspace of Neural Networks: Structural Analysis and Universal Attacks

Active subspace is a model reduction method widely used in the uncertain...

Please sign up or login with your details

Forgot password? Click here to reset