Rare-Event Simulation for Neural Network and Random Forest Predictors

by   Yuanlu Bai, et al.

We study rare-event simulation for a class of problems where the target hitting sets of interest are defined via modern machine learning tools such as neural networks and random forests. This problem is motivated from fast emerging studies on the safety evaluation of intelligent systems, robustness quantification of learning models, and other potential applications to large-scale simulation in which machine learning tools can be used to approximate complex rare-event set boundaries. We investigate an importance sampling scheme that integrates the dominating point machinery in large deviations and sequential mixed integer programming to locate the underlying dominating points. Our approach works for a range of neural network architectures including fully connected layers, rectified linear units, normalization, pooling and convolutional layers, and random forests built from standard decision trees. We provide efficiency guarantees and numerical demonstration of our approach using a classification model in the UCI Machine Learning Repository.



page 1

page 2

page 3

page 4


Certifiable Deep Importance Sampling for Rare-Event Simulation of Black-Box Systems

Rare-event simulation techniques, such as importance sampling (IS), cons...

Over-Conservativeness of Variance-Based Efficiency Criteria and Probabilistic Efficiency in Rare-Event Simulation

In rare-event simulation, an importance sampling (IS) estimator is regar...

Deep Probabilistic Accelerated Evaluation: A Certifiable Rare-Event Simulation Methodology for Black-Box Autonomy

Evaluating the reliability of intelligent physical systems against rare ...

Neural Random Forests

Given an ensemble of randomized regression trees, it is possible to rest...

Learning with rare data: Using active importance sampling to optimize objectives dominated by rare events

Deep neural networks, when optimized with sufficient data, provide accur...

Rare Event Simulation for non-Markovian repairable Fault Trees

Dynamic Fault Trees (DFT) are widely adopted in industry to assess the d...

Dominating Points of Gaussian Extremes

We quantify the large deviations of Gaussian extreme value statistics on...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.