Output-Weighted Importance Sampling for Bayesian Experimental Design and Uncertainty Quantification

06/22/2020
by   Antoine Blanchard, et al.
0

We introduce a class of acquisition functions for sample selection that leads to faster convergence in applications related to Bayesian experimental design and uncertainty quantification. The approach follows the paradigm of active learning, whereby existing samples of a black-box function are utilized to optimize the next most informative sample. The proposed method aims to take advantage of the fact that some input directions of the black-box function have a larger impact on the output than others, which is important especially for systems exhibiting rare and extreme events. The acquisition functions introduced in this work leverage the properties of the likelihood ratio, a quantity that acts as a probabilistic sampling weight and guides the active-learning algorithm towards regions of the input space that are deemed most relevant. We demonstrate superiority of the proposed approach in the uncertainty quantification of a hydrological system as well as the probabilistic quantification of rare events in dynamical systems and the identification of their precursors.

READ FULL TEXT

page 10

page 13

page 15

research
08/18/2016

Active Learning for Approximation of Expensive Functions with Normal Distributed Output Uncertainty

When approximating a black-box function, sampling with active learning f...
research
02/17/2023

Bayesian Quantification with Black-Box Estimators

Understanding how different classes are distributed in an unlabeled data...
research
08/28/2023

Distributionally Robust Statistical Verification with Imprecise Neural Networks

A particularly challenging problem in AI safety is providing guarantees ...
research
04/22/2020

Bayesian Optimization with Output-Weighted Importance Sampling

In Bayesian optimization, accounting for the importance of the output re...
research
01/31/2019

Bayesian active learning for optimization and uncertainty quantification in protein docking

Motivation: Ab initio protein docking represents a major challenge for o...
research
06/13/2023

User-defined Event Sampling and Uncertainty Quantification in Diffusion Models for Physical Dynamical Systems

Diffusion models are a class of probabilistic generative models that hav...
research
11/09/2019

Bayesian Active Learning for Structured Output Design

In this paper, we propose an active learning method for an inverse probl...

Please sign up or login with your details

Forgot password? Click here to reset