An efficient algorithm for estimating state sequences in imprecise hidden Markov models

10/05/2012
by   Jasper De Bock, et al.
0

We present an efficient exact algorithm for estimating state sequences from outputs (or observations) in imprecise hidden Markov models (iHMM), where both the uncertainty linking one state to the next, and that linking a state to its output, are represented using coherent lower previsions. The notion of independence we associate with the credal network representing the iHMM is that of epistemic irrelevance. We consider as best estimates for state sequences the (Walley--Sen) maximal sequences for the posterior joint state model conditioned on the observed output sequence, associated with a gain function that is the indicator of the state sequence. This corresponds to (and generalises) finding the state sequence with the highest posterior probability in HMMs with precise transition and output probabilities (pHMMs). We argue that the computational complexity is at worst quadratic in the length of the Markov chain, cubic in the number of states, and essentially linear in the number of maximal state sequences. For binary iHMMs, we investigate experimentally how the number of maximal state sequences depends on the model parameters. We also present a simple toy application in optical character recognition, demonstrating that our algorithm can be used to robustify the inferences made by precise probability models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/29/2023

Quick Adaptive Ternary Segmentation: An Efficient Decoding Procedure For Hidden Markov Models

Hidden Markov models (HMMs) are characterized by an unobservable (hidden...
research
03/15/2021

Regenerativity of Viterbi process for pairwise Markov models

For hidden Markov models one of the most popular estimates of the hidden...
research
12/11/2019

Gaussian Conditionally Markov Sequences: Dynamic Models and Representations of Reciprocal and Other Classes

Conditionally Markov (CM) sequences are powerful mathematical tools for ...
research
10/26/2021

Efficient Learning and Decoding of the Continuous-Time Hidden Markov Model for Disease Progression Modeling

The Continuous-Time Hidden Markov Model (CT-HMM) is an attractive approa...
research
04/17/2020

MAP segmentation in Bayesian hidden Markov models: a case study

We consider the problem of estimating the maximum posterior probability ...
research
08/15/2010

Epistemic irrelevance in credal nets: the case of imprecise Markov trees

We focus on credal nets, which are graphical models that generalise Baye...
research
05/30/2019

A Block Diagonal Markov Model for Indoor Software-Defined Power Line Communication

A Semi-Hidden Markov Model (SHMM) for bursty error channels is defined b...

Please sign up or login with your details

Forgot password? Click here to reset