DeepAI AI Chat
Log In Sign Up

Correlated pseudo-marginal Metropolis-Hastings using quasi-Newton proposals

by   Johan Dahlin, et al.
University of Newcastle

Pseudo-marginal Metropolis-Hastings (pmMH) is a versatile algorithm for sampling from target distributions which are not easy to evaluate point-wise. However, pmMH requires good proposal distributions to sample efficiently from the target, which can be problematic to construct in practice. This is especially a problem for high-dimensional targets when the standard random-walk proposal is inefficient. We extend pmMH to allow for constructing the proposal based on information from multiple past iterations. As a consequence, quasi-Newton (qN) methods can be employed to form proposals which utilize gradient information to guide the Markov chain to areas of high probability and to construct approximations of the local curvature to scale step sizes. The proposed method is demonstrated on several problems which indicate that qN proposals can perform better than other common Hessian-based proposals.


page 17

page 36

page 37


Quasi-Newton particle Metropolis-Hastings

Particle Metropolis-Hastings enables Bayesian parameter inference in gen...

Efficient Informed Proposals for Discrete Distributions via Newton's Series Approximation

Gradients have been exploited in proposal distributions to accelerate th...

Particle Metropolis-adjusted Langevin algorithms

This paper proposes a new sampling scheme based on Langevin dynamics tha...

System-Generated Requests for Rewriting Proposals

We present an online deliberation system using mutual evaluation in orde...

Gradient-based Adaptive Importance Samplers

Importance sampling (IS) is a powerful Monte Carlo methodology for the a...

Constructing Metropolis-Hastings proposals using damped BFGS updates

This paper considers the problem of computing Bayesian estimates of syst...

A multiple-try Metropolis-Hastings algorithm with tailored proposals

We present a new multiple-try Metropolis-Hastings algorithm designed to ...