A Review of Multiple Try MCMC algorithms for Signal Processing

01/27/2018
by   Luca Martino, et al.
0

Many applications in signal processing require the estimation of some parameters of interest given a set of observed data. More specifically, Bayesian inference needs the computation of a-posteriori estimators which are often expressed as complicated multi-dimensional integrals. Unfortunately, analytical expressions for these estimators cannot be found in most real-world applications, and Monte Carlo methods are the only feasible approach. A very powerful class of Monte Carlo techniques is formed by the Markov Chain Monte Carlo (MCMC) algorithms. They generate a Markov chain such that its stationary distribution coincides with the target posterior density. In this work, we perform a thorough review of MCMC methods using multiple candidates in order to select the next state of the chain, at each iteration. With respect to the classical Metropolis-Hastings method, the use of multiple try techniques foster the exploration of the sample space. We present different Multiple Try Metropolis schemes, Ensemble MCMC methods, Particle Metropolis-Hastings algorithms and the Delayed Rejection Metropolis technique. We highlight limitations, benefits, connections and differences among the different methods, and compare them by numerical simulations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/25/2021

A Survey of Monte Carlo Methods for Parameter Estimation

Statistical signal processing applications usually require the estimatio...
research
07/30/2015

Orthogonal parallel MCMC methods for sampling and optimization

Monte Carlo (MC) methods are widely used for Bayesian inference and opti...
research
10/28/2016

Fuzzy Bayesian Learning

In this paper we propose a novel approach for learning from data using r...
research
11/21/2022

Improving multiple-try Metropolis with local balancing

Multiple-try Metropolis (MTM) is a popular Markov chain Monte Carlo meth...
research
05/06/2021

MCMC-driven importance samplers

Monte Carlo methods are the standard procedure for estimating complicate...
research
05/20/2019

Exploring helical dynamos with machine learning

We use ensemble machine learning algorithms to study the evolution of ma...
research
10/31/2022

Decorrelating ReSTIR Samplers via MCMC Mutations

Monte Carlo rendering algorithms often utilize correlations between pixe...

Please sign up or login with your details

Forgot password? Click here to reset