Learning Hidden Markov Models from Aggregate Observations

11/23/2020
by   Rahul Singh, et al.
0

In this paper, we propose an algorithm for estimating the parameters of a time-homogeneous hidden Markov model from aggregate observations. This problem arises when only the population level counts of the number of individuals at each time step are available, from which one seeks to learn the individual hidden Markov model. Our algorithm is built upon expectation-maximization and the recently proposed aggregate inference algorithm, the Sinkhorn belief propagation. As compared with existing methods such as expectation-maximization with non-linear belief propagation, our algorithm exhibits convergence guarantees. Moreover, our learning framework naturally reduces to the standard Baum-Welch learning algorithm when observations corresponding to a single individual are recorded. We further extend our learning algorithm to handle HMMs with continuous observations. The efficacy of our algorithm is demonstrated on a variety of datasets.

READ FULL TEXT
research
07/24/2021

Inference of collective Gaussian hidden Markov models

We consider inference problems for a class of continuous state collectiv...
research
09/11/2018

Learning Scripts as Hidden Markov Models

Scripts have been proposed to model the stereotypical event sequences fo...
research
10/06/2009

Reduced-Rank Hidden Markov Models

We introduce the Reduced-Rank Hidden Markov Model (RR-HMM), a generaliza...
research
11/04/2020

Filtering for Aggregate Hidden Markov Models with Continuous Observations

We consider a class of filtering problems for large populations where ea...
research
07/22/2018

Learning Deep Hidden Nonlinear Dynamics from Aggregate Data

Learning nonlinear dynamics from diffusion data is a challenging problem...
research
04/14/2016

Consistently Estimating Markov Chains with Noisy Aggregate Data

We address the problem of estimating the parameters of a time-homogeneou...
research
03/08/2022

Online Target Localization using Adaptive Belief Propagation in the HMM Framework

This paper proposes a novel adaptive sample space-based Viterbi algorith...

Please sign up or login with your details

Forgot password? Click here to reset