Hidden Markov Models with mixtures as emission distributions

06/22/2012
by   Stevenn Volant, et al.
0

In unsupervised classification, Hidden Markov Models (HMM) are used to account for a neighborhood structure between observations. The emission distributions are often supposed to belong to some parametric family. In this paper, a semiparametric modeling where the emission distributions are a mixture of parametric distributions is proposed to get a higher flexibility. We show that the classical EM algorithm can be adapted to infer the model parameters. For the initialisation step, starting from a large number of components, a hierarchical method to combine them into the hidden states is proposed. Three likelihood-based criteria to select the components to be combined are discussed. To estimate the number of hidden states, BIC-like criteria are derived. A simulation study is carried out both to determine the best combination between the merging criteria and the model selection criteria and to evaluate the accuracy of classification. The proposed method is also illustrated using a biological dataset from the model plant Arabidopsis thaliana. A R package HMMmix is freely available on the CRAN.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/08/2023

Are Information criteria good enough to choose the right the number of regimes in Hidden Markov Models?

Selecting the number of regimes in Hidden Markov models is an important ...
research
02/15/2021

Robust Classification using Hidden Markov Models and Mixtures of Normalizing Flows

We test the robustness of a maximum-likelihood (ML) based classifier whe...
research
11/28/2018

Asymptotic Analysis of Model Selection Criteria for General Hidden Markov Models

The paper obtains analytical results for the asymptotic properties of Mo...
research
01/22/2021

Flexible estimation of the state dwell-time distribution in hidden semi-Markov models

Hidden semi-Markov models generalise hidden Markov models by explicitly ...
research
05/20/2020

Hidden Markov Models and their Application for Predicting Failure Events

We show how Markov mixed membership models (MMMM) can be used to predict...
research
05/19/2017

Beyond similarity assessment: Selecting the optimal model for sequence alignment via the Factorized Asymptotic Bayesian algorithm

Pair Hidden Markov Models (PHMMs) are probabilistic models used for pair...
research
06/16/2016

Unsupervised Risk Estimation Using Only Conditional Independence Structure

We show how to estimate a model's test error from unlabeled data, on dis...

Please sign up or login with your details

Forgot password? Click here to reset