The Coupled Rejection Sampler

01/24/2022
by   Adrien Corenflos, et al.
0

We propose a coupled rejection-sampling method for sampling from couplings of arbitrary distributions. The method relies on accepting or rejecting coupled samples coming from dominating marginals. Contrary to existing acceptance-rejection coupling methods, the variance of the execution time of the proposed method is limited and stays finite as the two target marginals approach each other in the sense of the total variation norm. In the important special case of coupling multivariate Gaussians with different means and covariances, we derive positive lower bounds for the resulting coupling probability of our algorithm, and we then show how the coupling method can be optimized in closed form. Finally, we show how we can modify the coupled rejection-sampling method to propose from coupled ensemble of proposals, so as to asymptotically recover a maximal coupling. We then apply the method to the problem of coupling rare events samplers, derive a parallel coupled resampling algorithm to use in particle filtering, and show how the coupled rejection-sampler can be used to speed up unbiased MCMC methods based on couplings.

READ FULL TEXT
research
08/28/2020

Double Happiness: Enhancing the Coupled Gains of L-lag Coupling via Control Variates

The recently proposed L-lag coupling for unbiased MCMC <cit.> calls for ...
research
04/04/2018

Use of the geometric mean as a statistic for the scale of the coupled Gaussian distributions

The geometric mean is shown to be an appropriate statistic for the scale...
research
06/15/2018

Coupled conditional backward sampling particle filter

We consider the coupled conditional backward sampling particle filter (C...
research
12/19/2017

Asymptotic Coupling and Its Applications in Information Theory

A coupling of two distributions P_X and P_Y is a joint distribution P_XY...
research
05/31/2023

End-to-end Training of Deep Boltzmann Machines by Unbiased Contrastive Divergence with Local Mode Initialization

We address the problem of biased gradient estimation in deep Boltzmann m...
research
11/22/2022

A new and asymptotically optimally contracting coupling for the random walk Metropolis

The reflection-maximal coupling of the random walk Metropolis (RWM) algo...
research
07/01/2020

Coupling Learning of Complex Interactions

Complex applications such as big data analytics involve different forms ...

Please sign up or login with your details

Forgot password? Click here to reset