A Linear-Time Particle Gibbs Sampler for Infinite Hidden Markov Models

05/03/2015
by   Nilesh Tripuraneni, et al.
0

Infinite Hidden Markov Models (iHMM's) are an attractive, nonparametric generalization of the classical Hidden Markov Model which can automatically infer the number of hidden states in the system. However, due to the infinite-dimensional nature of transition dynamics performing inference in the iHMM is difficult. In this paper, we present an infinite-state Particle Gibbs (PG) algorithm to resample state trajectories for the iHMM. The proposed algorithm uses an efficient proposal optimized for iHMMs and leverages ancestor sampling to suppress degeneracy of the standard PG algorithm. Our algorithm demonstrates significant convergence improvements on synthetic and real world data sets. Additionally, the infinite-state PG algorithm has linear-time complexity in the number of states in the sampler, while competing methods scale quadratically.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/30/2014

Infinite Structured Hidden Semi-Markov Models

This paper reviews recent advances in Bayesian nonparametric techniques ...
research
07/21/2017

An Infinite Hidden Markov Model With Similarity-Biased Transitions

We describe a generalization of the Hierarchical Dirichlet Process Hidde...
research
06/02/2011

Restricted Collapsed Draw: Accurate Sampling for Hierarchical Chinese Restaurant Process Hidden Markov Models

We propose a restricted collapsed draw (RCD) sampler, a general Markov c...
research
06/27/2012

Gene Expression Time Course Clustering with Countably Infinite Hidden Markov Models

Most existing approaches to clustering gene expression time course data ...
research
02/12/2020

Health Assessment and Prognostics Based on Higher Order Hidden Semi-Markov Models

This paper presents a new and flexible prognostics framework based on a ...
research
11/07/2018

Optimized Hidden Markov Model based on Constrained Particle Swarm Optimization

As one of Bayesian analysis tools, Hidden Markov Model (HMM) has been us...
research
06/19/2017

Infinite Mixture Model of Markov Chains

We propose a Bayesian nonparametric mixture model for prediction- and in...

Please sign up or login with your details

Forgot password? Click here to reset