Data Reduction in Markov model using EM algorithm

07/16/2018
by   Atanu Kumar Ghosh, et al.
0

This paper describes a data reduction technique in case of a markov chain of specified order. Instead of observing all the transitions in a markov chain we record only a few of them and treat the remaining part as missing. The decision about which transitions to be filtered is taken before the observation process starts. Based on the filtered chain we try to estimate the parameters of the markov model using EM algorithm. In the first half of the paper we characterize a class of filtering mechanism for which all the parameters remain identifiable. In the later half we explain methods of estimation and testing about the transition probabilities of the markov chain based on the filtered data. The methods are first developed assuming a simple markov model with each probability of transition positive, but then generalized for models with structural zeroes in the transition probability matrix. Further extension is also done for multiple markov chains. The performance of the developed method of estimation is studied using simulated data along with a real life data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/20/2014

Prediction of Synchrostate Transitions in EEG Signals Using Markov Chain Models

This paper proposes a stochastic model using the concept of Markov chain...
research
07/09/2017

Unified Method for Markov Chain Transition Model Estimation Using Incomplete Survey Data

The Future Elderly Model and related microsimulations are modeled as Mar...
research
06/03/2019

Pangloss: a novel Markov chain prefetcher

We present Pangloss, an efficient high-performance data prefetcher that ...
research
07/02/2020

A hybrid landmark Aalen-Johansen estimator for transition probabilities in partially non-Markov multi-state models

Violations of the Markov assumption in multi-state models are not uncomm...
research
08/05/2018

Simulating Raga Notes with a Markov Chain of Order 1-2

Semi Natural Algorithmic composition (SNCA) is the technique of using al...
research
04/16/2023

Second Order Markov multistate models

Multistate models (MSM) are well developed for continuous and discrete t...
research
10/30/2020

Centralized active tracking of a Markov chain with unknown dynamics

In this paper, selection of an active sensor subset for tracking a discr...

Please sign up or login with your details

Forgot password? Click here to reset