The Cover Time of a (Multiple) Markov Chain with Rational Transition Probabilities is Rational

02/24/2021
by   John Sylvester, et al.
0

The cover time of a Markov chain on a finite state space is the expected time until all states are visited. We show that if the cover time of a discrete-time Markov chain with rational transitions probabilities is bounded, then it is a rational number. The result is proved by relating the cover time of the original chain to the hitting time of a set in another higher dimensional chain. We also extend this result to the setting where k≥ 1 independent copies of a Markov chain are run simultaneously on the same state space and the cover time is the expected time until each state has been visited by at least one copy of the chain.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/06/2017

A new belief Markov chain model and its application in inventory prediction

Markov chain model is widely applied in many fields, especially the fiel...
research
08/09/2014

Sensitivity analysis for finite Markov chains in discrete time

When the initial and transition probabilities of a finite Markov chain i...
research
04/08/2023

Asymptotic normality in multi-dimension of nonparametric estimators for discrete-time semi-Markov chains

The asymptotic normality in multi-dimension of the nonparametric estimat...
research
04/05/2019

Rare Event Simulation for Steady-State Probabilities via Recurrency Cycles

We develop a new algorithm for the estimation of rare event probabilitie...
research
06/03/2019

Pangloss: a novel Markov chain prefetcher

We present Pangloss, an efficient high-performance data prefetcher that ...
research
10/17/2021

A Markov Chain Model for COVID19 in Mexico City

This paper presents a model for COVID19 in Mexico City. The data analyze...
research
08/02/2016

Rate Reduction for State-labelled Markov Chains with Upper Time-bounded CSL Requirements

This paper presents algorithms for identifying and reducing a dedicated ...

Please sign up or login with your details

Forgot password? Click here to reset