Large deviation theory-based adaptive importance sampling for rare events in high dimensions

09/13/2022
by   Shanyin Tong, et al.
0

We propose a method for the accurate estimation of rare event or failure probabilities for expensive-to-evaluate numerical models in high dimensions. The proposed approach combines ideas from large deviation theory and adaptive importance sampling. The importance sampler uses a cross-entropy method to find an optimal Gaussian biasing distribution, and reuses all samples made throughout the process for both, the target probability estimation and for updating the biasing distributions. Large deviation theory is used to find a good initial biasing distribution through the solution of an optimization problem. Additionally, it is used to identify a low-dimensional subspace that is most informative of the rare event probability. This subspace is used for the cross-entropy method, which is known to lose efficiency in higher dimensions. The proposed method does not require smoothing of indicator functions nor does it involve numerical tuning parameters. We compare the method with a state-of-the-art cross-entropy-based importance sampling scheme using three examples: a high-dimensional failure probability estimation benchmark, a problem governed by a diffusion equation, and a tsunami problem governed by the time-dependent shallow water system in one spatial dimension.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/21/2020

Improvement of the cross-entropy method in high dimension through a one-dimensional projection without gradient estimation

Rare event probability estimation is an important topic in reliability a...
research
06/09/2020

Cross-entropy-based importance sampling with failure-informed dimension reduction for rare event simulation

The estimation of rare event or failure probabilities in high dimensions...
research
07/28/2020

Extreme event probability estimation using PDE-constrained optimization and large deviation theory, with application to tsunamis

We propose and compare methods for the estimation of extreme event proba...
research
10/10/2020

SYMPAIS: SYMbolic Parallel Adaptive Importance Sampling for Probabilistic Program Analysis

Probabilistic software analysis aims at quantifying the probability of a...
research
06/05/2018

Adapting Reduced Models in the Cross-Entropy Method

This paper deals with the estimation of rare event probabilities using i...
research
04/04/2022

Test Against High-Dimensional Uncertainties: Accelerated Evaluation of Autonomous Vehicles with Deep Importance Sampling

Evaluating the performance of autonomous vehicles (AV) and their complex...
research
08/11/2020

Learning with rare data: Using active importance sampling to optimize objectives dominated by rare events

Deep neural networks, when optimized with sufficient data, provide accur...

Please sign up or login with your details

Forgot password? Click here to reset