On approximating the stationary distribution of time-reversible Markov chains

12/30/2017
by   Marco Bressan, et al.
0

Approximating the stationary probability of a state in a Markov chain through Markov chain Monte Carlo techniques is, in general, inefficient. Standard random walk approaches require Õ(τ/π(v)) operations to approximate the probability π(v) of a state v in a chain with mixing time τ, and even the best available techniques still have complexity Õ(τ^1.5/π(v)^0.5), and since these complexities depend inversely on π(v), they can grow beyond any bound in the size of the chain or in its mixing time. In this paper we show that, for time-reversible Markov chains, there exists a simple randomized approximation algorithm that breaks this "small-π(v) barrier".

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/04/2015

Sequential quantum mixing for slowly evolving sequences of Markov chains

In this work we consider the problem of preparation of the stationary di...
research
11/10/2021

Geometric Bounds on the Fastest Mixing Markov Chain

In the Fastest Mixing Markov Chain problem, we are given a graph G = (V,...
research
10/27/2017

Rapidly Mixing Markov Chain Monte Carlo Technique for Matching Problems with Global Utility Function

This paper deals with a complete bipartite matching problem with the obj...
research
06/14/2022

Space-efficient Quantization Method for Reversible Markov Chains

In a seminal paper, Szegedy showed how to construct a quantum walk W(P) ...
research
01/11/2017

Fast mixing for Latent Dirichlet allocation

Markov chain Monte Carlo (MCMC) algorithms are ubiquitous in probability...
research
06/09/2022

An approximation algorithm for random generation of capacities

Capacities on a finite set are sets functions vanishing on the empty set...
research
08/28/2022

Metastable Mixing of Markov Chains: Efficiently Sampling Low Temperature Exponential Random Graphs

In this paper we consider the problem of sampling from the low-temperatu...

Please sign up or login with your details

Forgot password? Click here to reset