Variational Bayesian Inference for Hidden Markov Models With Multivariate Gaussian Output Distributions

05/27/2016
by   Christian Gruhl, et al.
0

Hidden Markov Models (HMM) have been used for several years in many time series analysis or pattern recognitions tasks. HMM are often trained by means of the Baum-Welch algorithm which can be seen as a special variant of an expectation maximization (EM) algorithm. Second-order training techniques such as Variational Bayesian Inference (VI) for probabilistic models regard the parameters of the probabilistic models as random variables and define distributions over these distribution parameters, hence the name of this technique. VI can also bee regarded as a special case of an EM algorithm. In this article, we bring both together and train HMM with multivariate Gaussian output distributions with VI. The article defines the new training technique for HMM. An evaluation based on some case studies and a comparison to related approaches is part of our ongoing work.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/15/2012

HMRF-EM-image: Implementation of the Hidden Markov Random Field Model and its Expectation-Maximization Algorithm

In this project, we study the hidden Markov random field (HMRF) model an...
research
01/24/2023

Context-specific kernel-based hidden Markov model for time series analysis

Traditional hidden Markov models have been a useful tool to understand a...
research
04/23/2020

Edge Detection using Stationary Wavelet Transform, HMM, and EM algorithm

Stationary Wavelet Transform (SWT) is an efficient tool for edge analysi...
research
07/08/2022

Copula Modelling of Serially Correlated Multivariate Data with Hidden Structures

We propose a copula-based extension of the hidden Markov model (HMM) whi...
research
04/15/2020

Dynamic Bayesian Neural Networks

We define an evolving in time Bayesian neural network called a Hidden Ma...
research
10/23/2020

From the Expectation Maximisation Algorithm to Autoencoded Variational Bayes

Although the expectation maximisation (EM) algorithm was introduced in 1...
research
07/05/2022

Stochastic Variational Methods in Generalized Hidden Semi-Markov Models to Characterize Functionality in Random Heteropolymers

Recent years have seen substantial advances in the development of biofun...

Please sign up or login with your details

Forgot password? Click here to reset