Prediction and Generation of Binary Markov Processes: Can a Finite-State Fox Catch a Markov Mouse?

08/01/2017
by   J. Ruebeck, et al.
0

Understanding the generative mechanism of a natural system is a vital component of the scientific method. Here, we investigate one of the fundamental steps toward this goal by presenting the minimal generator of an arbitrary binary Markov process. This is a class of processes whose predictive model is well known. Surprisingly, the generative model requires three distinct topologies for different regions of parameter space. We show that a previously proposed generator for a particular set of binary Markov processes is, in fact, not minimal. Our results shed the first quantitative light on the relative (minimal) costs of prediction and generation. We find, for instance, that the difference between prediction and generation is maximized when the process is approximately independently, identically distributed.

READ FULL TEXT

page 7

page 10

research
11/18/2011

Equivalence of History and Generator Epsilon-Machines

Epsilon-machines are minimal, unifilar presentations of stationary stoch...
research
03/31/2022

On structural parameter estimation of the Markov Q-process

In the paper we consider a stochastic model which called Markov Q-proces...
research
02/21/2021

Divergent Predictive States: The Statistical Complexity Dimension of Stationary, Ergodic Hidden Markov Processes

Even simply-defined, finite-state generators produce stochastic processe...
research
08/29/2020

Shannon Entropy Rate of Hidden Markov Processes

Hidden Markov chains are widely applied statistical models of stochastic...
research
02/27/2017

Nearly Maximally Predictive Features and Their Dimensions

Scientific explanation often requires inferring maximally predictive fea...
research
05/14/2022

ACID: A Low Dimensional Characterization of Markov-Modulated and Self-Exciting Counting Processes

The conditional intensity (CI) of a counting process Y_t is based on the...
research
12/07/2022

Modelling Correlated Bernoulli Data Part II: Inference

Binary data are highly common in many applications, however it is usuall...

Please sign up or login with your details

Forgot password? Click here to reset