On the Ergodicity, Bias and Asymptotic Normality of Randomized Midpoint Sampling Method

11/06/2020
by   Ye He, et al.
0

The randomized midpoint method, proposed by [SL19], has emerged as an optimal discretization procedure for simulating the continuous time Langevin diffusions. Focusing on the case of strong-convex and smooth potentials, in this paper, we analyze several probabilistic properties of the randomized midpoint discretization method for both overdamped and underdamped Langevin diffusions. We first characterize the stationary distribution of the discrete chain obtained with constant step-size discretization and show that it is biased away from the target distribution. Notably, the step-size needs to go to zero to obtain asymptotic unbiasedness. Next, we establish the asymptotic normality for numerical integration using the randomized midpoint method and highlight the relative advantages and disadvantages over other discretizations. Our results collectively provide several insights into the behavior of the randomized midpoint discretization method, including obtaining confidence intervals for numerical integrations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/02/2021

Asymptotic bias of inexact Markov Chain Monte Carlo methods in high dimension

This paper establishes non-asymptotic bounds on Wasserstein distances be...
research
02/15/2021

On Riemannian Stochastic Approximation Schemes with Fixed Step-Size

This paper studies fixed step-size stochastic approximation (SA) schemes...
research
11/29/2014

Constant Step Size Least-Mean-Square: Bias-Variance Trade-offs and Optimal Sampling Distributions

We consider the least-squares regression problem and provide a detailed ...
research
12/11/2016

Baby-Step Giant-Step Algorithms for the Symmetric Group

We study discrete logarithms in the setting of group actions. Suppose th...
research
10/29/2021

New Step-Size Criterion for the Steepest Descent based on Geometric Numerical Integration

This paper deals with unconstrained optimization problems based on numer...
research
02/03/2021

Simulated annealing from continuum to discretization: a convergence analysis via the Eyring–Kramers law

We study the convergence rate of continuous-time simulated annealing (X_...
research
07/30/2020

When are Neural ODE Solutions Proper ODEs?

A key appeal of the recently proposed Neural Ordinary Differential Equat...

Please sign up or login with your details

Forgot password? Click here to reset