Randomized multilevel Monte Carlo for embarrassingly parallel inference

07/05/2021
by   Ajay Jasra, et al.
0

This position paper summarizes a recently developed research program focused on inference in the context of data centric science and engineering applications, and forecasts its trajectory forward over the next decade. Often one endeavours in this context to learn complex systems in order to make more informed predictions and high stakes decisions under uncertainty. Some key challenges which must be met in this context are robustness, generalizability, and interpretability. The Bayesian framework addresses these three challenges, while bringing with it a fourth, undesirable feature: it is typically far more expensive than its deterministic counterparts. In the 21st century, and increasingly over the past decade, a growing number of methods have emerged which allow one to leverage cheap low-fidelity models in order to precondition algorithms for performing inference with more expensive models and make Bayesian inference tractable in the context of high-dimensional and expensive models. Notable examples are multilevel Monte Carlo (MLMC), multi-index Monte Carlo (MIMC), and their randomized counterparts (rMLMC), which are able to provably achieve a dimension-independent (including ∞-dimension) canonical complexity rate with respect to mean squared error (MSE) of 1/MSE. Some parallelizability is typically lost in an inference context, but recently this has been largely recovered via novel double randomization approaches. Such an approach delivers i.i.d. samples of quantities of interest which are unbiased with respect to the infinite resolution target distribution. Over the coming decade, this family of algorithms has the potential to transform data centric science and engineering, as well as classical machine learning applications such as deep learning, by scaling up and scaling out fully Bayesian inference.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/10/2022

Multi-index Sequential Monte Carlo ratio estimators for Bayesian Inverse problems

We consider the problem of estimating expectations with respect to a tar...
research
10/27/2022

A randomized Multi-index sequential Monte Carlo method

We consider the problem of estimating expectations with respect to a tar...
research
07/31/2023

A multilevel Monte Carlo algorithm for SDEs driven by countably dimensional Wiener process and Poisson random measure

In this paper, we investigate the properties of standard and multilevel ...
research
03/24/2022

Multilevel Bayesian Deep Neural Networks

In this article we consider Bayesian inference associated to deep neural...
research
11/08/2017

Multilevel Monte Carlo for Smoothing via Transport Methods

In this article we consider recursive approximations of the smoothing di...
research
10/04/2022

Multi-fidelity Monte Carlo: a pseudo-marginal approach

Markov chain Monte Carlo (MCMC) is an established approach for uncertain...

Please sign up or login with your details

Forgot password? Click here to reset