On Unbiased Estimation for Discretized Models

02/24/2021
by   Jeremy Heng, et al.
0

In this article, we consider computing expectations w.r.t. probability measures which are subject to discretization error. Examples include partially observed diffusion processes or inverse problems, where one may have to discretize time and/or space, in order to practically work with the probability of interest. Given access only to these discretizations, we consider the construction of unbiased Monte Carlo estimators of expectations w.r.t. such target probability distributions. It is shown how to obtain such estimators using a novel adaptation of randomization schemes and Markov simulation methods. Under appropriate assumptions, these estimators possess finite variance and finite expected cost. There are two important consequences of this approach: (i) unbiased inference is achieved at the canonical complexity rate, and (ii) the resulting estimators can be generated independently, thereby allowing strong scaling to arbitrarily many parallel processors. Several algorithms are presented, and applied to some examples of Bayesian inference problems, with both simulated and real observed data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/11/2021

On Unbiased Score Estimation for Partially Observed Diffusions

We consider the problem of statistical inference for a class of partiall...
research
06/14/2022

Unbiased Estimation using the Underdamped Langevin Dynamics

In this work we consider the unbiased estimation of expectations w.r.t. ...
research
04/11/2022

Unbiased Multilevel Monte Carlo methods for intractable distributions: MLMC meets MCMC

Constructing unbiased estimators from Markov chain Monte Carlo (MCMC) ou...
research
04/12/2023

Probability-Based Estimation

We develop a theory of estimation when in addition to a sample of n obse...
research
07/20/2023

Unbiased analytic non-parametric correlation estimators in the presence of ties

An inner-product Hilbert space formulation is defined over a domain of a...
research
03/10/2020

Unbiased Estimation of the Gradient of the Log-Likelihood in Inverse Problems

We consider the problem of estimating a parameter associated to a Bayesi...
research
02/04/2020

Unbiased Estimation of the Solution to Zakai's Equation

In the following article we consider the non-linear filtering problem in...

Please sign up or login with your details

Forgot password? Click here to reset