DeepAI AI Chat
Log In Sign Up

Gaussian Approximation of Collective Graphical Models

by   Li-Ping Liu, et al.

The Collective Graphical Model (CGM) models a population of independent and identically distributed individuals when only collective statistics (i.e., counts of individuals) are observed. Exact inference in CGMs is intractable, and previous work has explored Markov Chain Monte Carlo (MCMC) and MAP approximations for learning and inference. This paper studies Gaussian approximations to the CGM. As the population grows large, we show that the CGM distribution converges to a multivariate Gaussian distribution (GCGM) that maintains the conditional independence properties of the original CGM. If the observations are exact marginals of the CGM or marginals that are corrupted by Gaussian noise, inference in the GCGM approximation can be computed efficiently in closed form. If the observations follow a different noise model (e.g., Poisson), then expectation propagation provides efficient and accurate approximate inference. The accuracy and speed of GCGM inference is compared to the MCMC and MAP methods on a simulated bird migration problem. The GCGM matches or exceeds the accuracy of the MAP method while being significantly faster.


page 1

page 2

page 3

page 4


Fast Bayesian Restoration of Poisson Corrupted Images with INLA

Photon-limited images are often seen in fields such as medical imaging. ...

The G-Wishart Weighted Proposal Algorithm: Efficient Posterior Computation for Gaussian Graphical Models

Gaussian graphical models can capture complex dependency structures amon...

Efficient Bayesian computation for low-photon imaging problems

This paper studies a new and highly efficient Markov chain Monte Carlo (...

Nested Expectation Propagation for Gaussian Process Classification with a Multinomial Probit Likelihood

We consider probabilistic multinomial probit classification using Gaussi...

Sketching for Latent Dirichlet-Categorical Models

Recent work has explored transforming data sets into smaller, approximat...

Inference of collective Gaussian hidden Markov models

We consider inference problems for a class of continuous state collectiv...

Exact and Efficient Bayesian Inference for Privacy Risk Quantification (Extended Version)

Data analysis has high value both for commercial and research purposes. ...