Convergence rates for Metropolis-Hastings algorithms in the Wasserstein distance

11/19/2021
by   Austin Brown, et al.
0

We develop necessary conditions for geometrically fast convergence in the Wasserstein distance for Metropolis-Hastings algorithms on ℝ^d when the metric used is a norm. This is accomplished through a lower bound which is of independent interest. We show exact convergence expressions in more general Wasserstein distances (e.g. total variation) can be achieved for a large class of distributions by centering an independent Gaussian proposal, that is, matching the optimal points of the proposal and target densities. This approach has applications for sampling posteriors of many popular Bayesian generalized linear models. In the case of Bayesian binary response regression, we show when the sample size n and the dimension d grow in such a way that the ratio d/n →γ∈ (0, +∞), the exact convergence rate can be upper bounded asymptotically.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/27/2020

Exact rate of convergence of the mean Wasserstein distance between the empirical and true Gaussian distribution

We study the Wasserstein distance W_2 for Gaussian samples. We establish...
research
08/06/2020

Exact Convergence Rate Analysis of the Independent Metropolis-Hastings Algorithms

A well-known difficult problem regarding Metropolis-Hastings algorithms ...
research
12/12/2022

Lower Bounds on the Rate of Convergence for Accept-Reject-Based Markov Chains

To avoid poor empirical performance in Metropolis-Hastings and other acc...
research
06/20/2020

Asymptotically Optimal Exact Minibatch Metropolis-Hastings

Metropolis-Hastings (MH) is a commonly-used MCMC algorithm, but it can b...
research
10/23/2020

The Wasserstein Impact Measure (WIM): a generally applicable, practical tool for quantifying prior impact in Bayesian statistics

The prior distribution is a crucial building block in Bayesian analysis,...
research
04/28/2023

On the 1-Wasserstein Distance between Location-Scale Distributions and the Effect of Differential Privacy

We provide an exact expressions for the 1-Wasserstein distance between i...
research
01/08/2022

Optimal 1-Wasserstein Distance for WGANs

The mathematical forces at work behind Generative Adversarial Networks r...

Please sign up or login with your details

Forgot password? Click here to reset