Variational Conditional-Dependence Hidden Markov Models for Human Action Recognition

Hidden Markov Models (HMMs) are a powerful generative approach for modeling sequential data and time-series in general. However, the commonly employed assumption of the dependence of the current time frame to a single or multiple immediately preceding frames is unrealistic; more complicated dynamics potentially exist in real world scenarios. Human Action Recognition constitutes such a scenario, and has attracted increased attention with the advent of low-cost 3D sensors. The naturally arising variations and complex temporal dependencies have established this task as a challenging problem in the community. This paper revisits conventional sequential modeling approaches, aiming to address the problem of capturing time-varying temporal dependency patterns. To this end, we propose a different formulation of HMMs, whereby the dependence on past frames is dynamically inferred from the data. Specifically, we introduce a hierarchical extension by postulating an additional latent variable layer; therein, the (time-varying) temporal dependence patterns are treated as latent variables over which inference is performed. We leverage solid arguments from the Variational Bayes framework and derive a tractable inference algorithm based on the forward-backward algorithm. As we experimentally show using benchmark datasets, our approach yields competitive recognition accuracy and can effectively handle data with missing values.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/29/2022

Learning Dependencies of Discrete Speech Representations with Neural Hidden Markov Models

While discrete latent variable models have had great success in self-sup...
research
05/30/2019

Factorized Inference in Deep Markov Models for Incomplete Multimodal Time Series

Integrating deep learning with latent state space models has the potenti...
research
08/27/2016

Learning Temporal Dependence from Time-Series Data with Latent Variables

We consider the setting where a collection of time series, modeled as ra...
research
02/08/2018

Bayesian analysis of predictive Non-Homogeneous hidden Markov models using Polya-Gamma data augmentation

We consider Non-Homogeneous Hidden Markov Models (NHHMMs) for forecastin...
research
02/23/2023

Generalization of Auto-Regressive Hidden Markov Models to Non-Linear Dynamics and Non-Euclidean Observation Space

Latent variable models are widely used to perform unsupervised segmentat...
research
02/12/2018

Latent variable time-varying network inference

In many applications of finance, biology and sociology, complex systems ...
research
09/01/2022

Temporal Conditional VAE for Distributional Drift Adaptation in Multivariate Time Series

Due to the nonstationary nature, the distribution of real-world multivar...

Please sign up or login with your details

Forgot password? Click here to reset