Variational Inference for Neyman-Scott Processes

03/07/2023
by   Chengkuan Hong, et al.
0

Neyman-Scott processes (NSPs) have been applied across a range of fields to model points or temporal events with a hierarchy of clusters. Markov chain Monte Carlo (MCMC) is typically used for posterior sampling in the model. However, MCMC's mixing time can cause the resulting inference to be slow, and thereby slow down model learning and prediction. We develop the first variational inference (VI) algorithm for NSPs, and give two examples of suitable variational posterior point process distributions. Our method minimizes the inclusive Kullback-Leibler (KL) divergence for VI to obtain the variational parameters. We generate samples from the approximate posterior point processes much faster than MCMC, as we can directly estimate the approximate posterior point processes without any MCMC steps or gradient descent. We include synthetic and real-world data experiments that demonstrate our VI algorithm achieves better prediction performance than MCMC when computational time is limited.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/20/2017

A Divergence Bound for Hybrids of MCMC and Variational Inference and an Application to Langevin Dynamics and SGVI

Two popular classes of methods for approximate inference are Markov chai...
research
09/25/2020

Stein Variational Gaussian Processes

We show how to use Stein variational gradient descent (SVGD) to carry ou...
research
06/09/2015

Variational consensus Monte Carlo

Practitioners of Bayesian statistics have long depended on Markov chain ...
research
02/17/2023

Piecewise Deterministic Markov Processes for Bayesian Neural Networks

Inference on modern Bayesian Neural Networks (BNNs) often relies on a va...
research
04/24/2020

Robust posterior inference when statistically emulating forward simulations

Scientific analyses often rely on slow, but accurate forward models for ...
research
03/23/2020

Markovian Score Climbing: Variational Inference with KL(p||q)

Modern variational inference (VI) uses stochastic gradients to avoid int...
research
02/28/2018

Approximate Inference for Constructing Astronomical Catalogs from Images

We present a new, fully generative model for constructing astronomical c...

Please sign up or login with your details

Forgot password? Click here to reset