Are Information criteria good enough to choose the right the number of regimes in Hidden Markov Models?

08/08/2023
by   Bouchra R. Nasri, et al.
0

Selecting the number of regimes in Hidden Markov models is an important problem. There are many criteria that are used to select this number, such as Akaike information criterion (AIC), Bayesian information criterion (BIC), integrated completed likelihood (ICL), deviance information criterion (DIC), and Watanabe-Akaike information criterion (WAIC), to name a few. In this article, we introduced goodness-of-fit tests for general Hidden Markov models with covariates, where the distribution of the observations is arbitrary, i.e., continuous, discrete, or a mixture of both. Then, a selection procedure is proposed based on this goodness-of-fit test. The main aim of this article is to compare the classical information criterion with the new criterion, when the outcome is either continuous, discrete or zero-inflated. Numerical experiments assess the finite sample performance of the goodness-of-fit tests, and comparisons between the different criteria are made.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/27/2020

Equivalence of Hidden Markov Models with Continuous Observations

We consider Hidden Markov Models that emit sequences of observations tha...
research
06/22/2012

Hidden Markov Models with mixtures as emission distributions

In unsupervised classification, Hidden Markov Models (HMM) are used to a...
research
11/28/2018

Asymptotic Analysis of Model Selection Criteria for General Hidden Markov Models

The paper obtains analytical results for the asymptotic properties of Mo...
research
03/14/2023

Kullback-Leibler Divergence and Akaike Information Criterion in General Hidden Markov Models

To characterize the Kullback-Leibler divergence and Fisher information i...
research
08/17/2023

Spectral information criterion for automatic elbow detection

We introduce a generalized information criterion that contains other wel...
research
05/19/2017

Beyond similarity assessment: Selecting the optimal model for sequence alignment via the Factorized Asymptotic Bayesian algorithm

Pair Hidden Markov Models (PHMMs) are probabilistic models used for pair...
research
02/27/2013

Three Approaches to Probability Model Selection

This paper compares three approaches to the problem of selecting among p...

Please sign up or login with your details

Forgot password? Click here to reset