Drift, Minorization, and Hitting Times

10/14/2019
by   Robert M. Anderson, et al.
0

The “drift-and-minorization” method, introduced and popularized in (Rosenthal, 1995; Meyn and Tweedie, 1994; Meyn and Tweedie, 2012), remains the most popular approach for bounding the convergence rates of Markov chains used in statistical computation. This approach requires estimates of two quantities: the rate at which a single copy of the Markov chain “drifts” towards a fixed “small set”, and a “minorization condition” which gives the worst-case time for two Markov chains started within the small set to couple with moderately large probability. In this paper, we build on (Oliveira, 2012; Peres and Sousi, 2015) and our work (Anderson, Duanmu, Smith, 2019a; Anderson, Duanmu, Smith, 2019b) to replace the “minorization condition” with an alternative “hitting condition” that is stated in terms of only one Markov chain.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/24/2020

The Coupling/Minorization/Drift Approach to Markov Chain Convergence Rates

This review paper provides an introduction of Markov chains and their co...
research
08/18/2019

Quantitative convergence rates for reversible Markov chains via strong random times

Let (X_t) be a discrete time Markov chain on a general state space. It i...
research
10/08/2021

Learning from non-irreducible Markov chains

Most of the existing literature on supervised learning problems focuses ...
research
08/30/2020

Improving graduation rate estimates using regularly updated Markov chains

American universities use a rolling six-year graduation rate (SYGR) to c...
research
03/14/2019

Markov-chain-inspired search for MH370

Markov-chain models are constructed for the probabilistic description of...
research
11/30/2019

Mix and Match: Markov Chains Mixing Times for Matching in Rideshare

Rideshare platforms such as Uber and Lyft dynamically dispatch drivers t...
research
01/23/2019

Stick-breaking processes, clumping, and Markov chain occupation laws

We consider the connections among `clumped' residual allocation models (...

Please sign up or login with your details

Forgot password? Click here to reset