Accelerating Stochastic Simulation with Interactive Neural Processes

06/05/2021
by   Dongxia Wu, et al.
0

Stochastic simulations such as large-scale, spatiotemporal, age-structured epidemic models are computationally expensive at fine-grained resolution. We propose Interactive Neural Process (INP), an interactive framework to continuously learn a deep learning surrogate model and accelerate simulation. Our framework is based on the novel integration of Bayesian active learning, stochastic simulation and deep sequence modeling. In particular, we develop a novel spatiotemporal neural process model to mimic the underlying process dynamics. Our model automatically infers the latent process which describes the intrinsic uncertainty of the simulator. This also gives rise to a new acquisition function that can quantify the uncertainty of deep learning predictions. We design Bayesian active learning algorithms to iteratively query the simulator, gather more data, and continuously improve the model. We perform theoretical analysis and demonstrate that our approach reduces sample complexity compared with random sampling in high dimension. Empirically, we demonstrate our framework can faithfully imitate the behavior of a complex infectious disease simulator with a small number of examples, enabling rapid simulation and scenario exploration.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/16/2022

Data efficient surrogate modeling for engineering design: Ensemble-free batch mode deep active learning for regression

In a computer-aided engineering design optimization problem that involve...
research
09/06/2023

Combining Thermodynamics-based Model of the Centrifugal Compressors and Active Machine Learning for Enhanced Industrial Design Optimization

The design process of centrifugal compressors requires applying an optim...
research
06/26/2017

Uncertainty Decomposition in Bayesian Neural Networks with Latent Variables

Bayesian neural networks (BNNs) with latent variables are probabilistic ...
research
11/25/2020

Surrogate-based Bayesian Comparison of Computationally Expensive Models: Application to Microbially Induced Calcite Precipitation

Geochemical processes in subsurface reservoirs affected by microbial act...
research
10/19/2017

Decomposition of Uncertainty for Active Learning and Reliable Reinforcement Learning in Stochastic Systems

Bayesian neural networks (BNNs) with latent variables are probabilistic ...
research
12/15/2020

Active Learning for Deep Gaussian Process Surrogates

Deep Gaussian processes (DGPs) are increasingly popular as predictive mo...
research
12/18/2018

Active learning for efficiently training emulators of computationally expensive mathematical models

An emulator is a fast-to-evaluate statistical approximation of a detaile...

Please sign up or login with your details

Forgot password? Click here to reset