On the α-lazy version of Markov chains in estimation and testing problems

05/20/2021
by   Sela Fried, et al.
0

We formulate extendibility of the minimax one-trajectory length of several statistical Markov chains inference problems and give sufficient conditions for both the possibility and impossibility of such extensions. We follow up and apply this framework to recently published results on learning and identity testing of ergodic Markov chains. In particular, we show that for some of the aforementioned results, we can omit the aperiodicity requirement by simulating an α-lazy version of the original process, and quantify the incurred cost of removing this assumption.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/13/2021

Identity testing of reversible Markov chains

We consider the problem of identity testing of Markov chains based on a ...
research
04/08/2019

Practical tests for significance in Markov Chains

We give improvements to theorems which enable significance testing in Ma...
research
02/06/2019

Testing Markov Chains without Hitting

We study the problem of identity testing of markov chains. In this setti...
research
11/14/2022

Offline Estimation of Controlled Markov Chains: Minimax Nonparametric Estimators and Sample Efficiency

Controlled Markov chains (CMCs) form the bedrock for model-based reinfor...
research
10/29/2019

Jump Markov Chains and Rejection-Free Metropolis Algorithms

We consider versions of the Metropolis algorithm which avoid the ineffic...
research
01/14/2020

FunMC: A functional API for building Markov Chains

Constant-memory algorithms, also loosely called Markov chains, power the...
research
06/10/2021

Dependence and mixing for perturbations of copula-based Markov chains

This paper explores the impact of perturbations of copulas on dependence...

Please sign up or login with your details

Forgot password? Click here to reset