Statistical Windows in Testing for the Initial Distribution of a Reversible Markov Chain

08/06/2018
by   Quentin Berthet, et al.
0

We study the problem of hypothesis testing between two discrete distributions, where we only have access to samples after the action of a known reversible Markov chain, playing the role of noise. We derive instance-dependent minimax rates for the sample complexity of this problem, and show how its dependence in time is related to the spectral properties of the Markov chain. We show that there exists a wide statistical window, in terms of sample complexity for hypothesis testing between different pairs of initial distributions. We illustrate these results in several concrete examples.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/16/2023

A Geometric Reduction Approach for Identity Testing of Reversible Markov Chains

We consider the problem of testing the identity of a reversible Markov c...
research
01/31/2019

Minimax Testing of Identity to a Reference Ergodic Markov Chain

We exhibit an efficient procedure for testing, based on a single long st...
research
02/22/2018

Entropy Rate Estimation for Markov Chains with Large State Space

Estimating the entropy based on data is one of the prototypical problems...
research
06/06/2022

Communication-constrained hypothesis testing: Optimality, robustness, and reverse data processing inequalities

We study hypothesis testing under communication constraints, where each ...
research
09/13/2018

Minimax Learning of Ergodic Markov Chains

We compute the finite-sample minimax (modulo logarithmic factors) sample...
research
09/06/2022

Three Distributions in the Extended Occupancy Problem

The classical and extended occupancy distributions are useful for examin...
research
06/01/2019

Graph-based Discriminators: Sample Complexity and Expressiveness

A basic question in learning theory is to identify if two distributions ...

Please sign up or login with your details

Forgot password? Click here to reset