Restart perturbations for lazy, reversible Markov chains: trichotomy and pre-cutoff equivalence

07/05/2019
by   Daniel Vial, et al.
0

Given a lazy, reversible Markov chain with n states and transition matrix P_n, a distribution σ_n over the states, and some α_n ∈ (0,1), we consider restart perturbations, which take the following form: with probability 1-α_n, sample the next state from P_n; with probability α_n, sample the next state from σ_n (i.e. "restart" at a random state). Our main object of study is π_n - π̃_n, where π_n and π̃_n are the stationarity distributions of the original and perturbed chains and · denotes total variation. Our first result characterizes π_n - π̃_n in terms of the ϵ-mixing times t_mix^(n)(ϵ) of the P_n chain, assuming these mixing times exhibit cutoff. Namely, we show that if α_n t_mix^(n)(ϵ) → 0, then π_n - π̃_n → 0 for any restart perturbation; if α_n t_mix^(n)(ϵ) →∞, then π_n - π̃_n → 1 for some restart perturbation; and if α_n t_mix^(n)(ϵ) → c ∈ (0,∞), then _n →∞π_n - π̃_n ≤ 1 - e^-c for any restart perturbation (and the bound is tight). Similar "trichotomies" have appeared in several result results; however, these existing results consider generative models for the chain, whereas ours applies more broadly. Our second result shows the weaker notion of pre-cutoff is (almost) equivalent to a certain notion of "sensitivity to perturbation", in the sense that π_n - π̃_n → 1 for certain perturbations. This complements a recent result by Basu, Hermon, and Peres, which shows that cutoff is equivalent to a certain notion of "hitting time cutoff".

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/12/2021

Perturbations of copulas and Mixing properties

This paper explores the impact of perturbations of copulas on the depend...
research
03/04/2015

Sequential quantum mixing for slowly evolving sequences of Markov chains

In this work we consider the problem of preparation of the stationary di...
research
08/28/2022

Metastable Mixing of Markov Chains: Efficiently Sampling Low Temperature Exponential Random Graphs

In this paper we consider the problem of sampling from the low-temperatu...
research
08/18/2021

Geometry-informed irreversible perturbations for accelerated convergence of Langevin dynamics

We introduce a novel geometry-informed irreversible perturbation that ac...
research
06/15/2022

Deterministic and Random Perturbations of the Kepler Problem

We investigate perturbations in the Kepler problem. We offer an overview...
research
03/18/2020

The influence of initial perturbation power spectra on the growth of a turbulent mixing layer induced by Richtmyer-Meshkov instability

This paper investigates the influence of different broadband perturbatio...
research
03/17/2014

A reversible infinite HMM using normalised random measures

We present a nonparametric prior over reversible Markov chains. We use c...

Please sign up or login with your details

Forgot password? Click here to reset