Robust Parametric Inference for Finite Markov Chains

04/02/2020
by   Abhik Ghosh, et al.
0

We consider the problem of statistical inference in a parametric finite Markov chain model and develop a robust estimator of the parameters defining the transition probabilities via the minimization of a suitable (empirical) version of the popular density power divergence. Based on a long sequence of observations from the underlying first-order stationary Markov chain, we have defined the minimum density power divergence estimator (MDPDE) of the underlying parameter and rigorously derive its asymptotic and robustness properties under appropriate conditions. The performance of our proposed MDPDEs are illustrated theoretically as well as empirically for several common examples of finite Markov chain models. The application of the MDPDE in robust testing of statistical hypotheses is discussed along with the (parametric) comparison of two Markov chain sequences. Finally, several directions for extending the proposed approach of MDPDE and related inference are also briefly discussed for some useful extended set-ups like multiple sequences of Markov chains, higher order Markov chains and non-stationary Markov chains with time-dependent transition probabilities.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/08/2023

Asymptotic normality in multi-dimension of nonparametric estimators for discrete-time semi-Markov chains

The asymptotic normality in multi-dimension of the nonparametric estimat...
research
03/10/2019

Extreme events of higher-order Markov chains: hidden tail chains and extremal Yule-Walker equations

We derive some key extremal features for kth order Markov chains, which ...
research
07/19/2019

Are Parametric Markov Chains Monotonic?

This paper presents a simple algorithm to check whether reachability pro...
research
10/28/2018

On Learning Markov Chains

The problem of estimating an unknown discrete distribution from its samp...
research
06/15/2018

Selective Monitoring

We study selective monitors for labelled Markov chains. Monitors observe...
research
05/29/2020

Estimation of Semi-Markov Multi-state Models: A Comparison of the Sojourn Times and Transition Intensities Approaches

Semi-Markov models are widely used for survival analysis and reliability...
research
08/20/2020

Markov Chain-Based Stochastic Strategies for Robotic Surveillance

This article surveys recent advancements of strategy designs for persist...

Please sign up or login with your details

Forgot password? Click here to reset