Unbiased Estimation of the Gradient of the Log-Likelihood in Inverse Problems

03/10/2020
by   Ajay Jasra, et al.
0

We consider the problem of estimating a parameter associated to a Bayesian inverse problem. Treating the unknown initial condition as a nuisance parameter, typically one must resort to a numerical approximation of gradient of the log-likelihood and also adopt a discretization of the problem in space and/or time. We develop a new methodology to unbiasedly estimate the gradient of the log-likelihood with respect to the unknown parameter, i.e. the expectation of the estimate has no discretization bias. Such a property is not only useful for estimation in terms of the original stochastic model of interest, but can be used in stochastic gradient algorithms which benefit from unbiased estimates. Under appropriate assumptions, we prove that our estimator is not only unbiased but of finite variance. In addition, when implemented on a single processor, we show that the cost to achieve a given level of error is comparable to multilevel Monte Carlo methods, both practically and theoretically. However, the new algorithm provides the possibility for parallel computation on arbitrarily many processors without any loss of efficiency, asymptotically. In practice, this means any precision can be achieved for a fixed, finite constant cost, provided that enough processors are available.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/24/2021

Unbiased Estimation of the Gradient of the Log-Likelihood for a Class of Continuous-Time State-Space Models

In this paper, we consider static parameter estimation for a class of co...
research
02/23/2018

Accelerate iterated filtering

In simulation-based inferences for partially observed Markov process mod...
research
05/11/2021

On Unbiased Score Estimation for Partially Observed Diffusions

We consider the problem of statistical inference for a class of partiall...
research
02/24/2021

On Unbiased Estimation for Discretized Models

In this article, we consider computing expectations w.r.t. probability m...
research
02/04/2020

Unbiased Estimation of the Solution to Zakai's Equation

In the following article we consider the non-linear filtering problem in...
research
06/04/2021

Unbiased Optimal Stopping via the MUSE

We propose a new unbiased estimator for estimating the utility of the op...
research
10/27/2022

A randomized Multi-index sequential Monte Carlo method

We consider the problem of estimating expectations with respect to a tar...

Please sign up or login with your details

Forgot password? Click here to reset