Rare-Event Simulation for Neural Network and Random Forest Predictors

10/10/2020
by   Yuanlu Bai, et al.
0

We study rare-event simulation for a class of problems where the target hitting sets of interest are defined via modern machine learning tools such as neural networks and random forests. This problem is motivated from fast emerging studies on the safety evaluation of intelligent systems, robustness quantification of learning models, and other potential applications to large-scale simulation in which machine learning tools can be used to approximate complex rare-event set boundaries. We investigate an importance sampling scheme that integrates the dominating point machinery in large deviations and sequential mixed integer programming to locate the underlying dominating points. Our approach works for a range of neural network architectures including fully connected layers, rectified linear units, normalization, pooling and convolutional layers, and random forests built from standard decision trees. We provide efficiency guarantees and numerical demonstration of our approach using a classification model in the UCI Machine Learning Repository.

READ FULL TEXT

Authors

page 1

page 2

page 3

page 4

11/03/2021

Certifiable Deep Importance Sampling for Rare-Event Simulation of Black-Box Systems

Rare-event simulation techniques, such as importance sampling (IS), cons...
10/25/2021

Over-Conservativeness of Variance-Based Efficiency Criteria and Probabilistic Efficiency in Rare-Event Simulation

In rare-event simulation, an importance sampling (IS) estimator is regar...
06/28/2020

Deep Probabilistic Accelerated Evaluation: A Certifiable Rare-Event Simulation Methodology for Black-Box Autonomy

Evaluating the reliability of intelligent physical systems against rare ...
04/25/2016

Neural Random Forests

Given an ensemble of randomized regression trees, it is possible to rest...
08/11/2020

Learning with rare data: Using active importance sampling to optimize objectives dominated by rare events

Deep neural networks, when optimized with sufficient data, provide accur...
10/23/2019

Rare Event Simulation for non-Markovian repairable Fault Trees

Dynamic Fault Trees (DFT) are widely adopted in industry to assess the d...
10/29/2018

Dominating Points of Gaussian Extremes

We quantify the large deviations of Gaussian extreme value statistics on...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.