Slice Sampling for General Completely Random Measures

06/24/2020
by   Peiyuan Zhu, et al.
0

Completely random measures provide a principled approach to creating flexible unsupervised models, where the number of latent features is infinite and the number of features that influence the data grows with the size of the data set. Due to the infinity the latent features, posterior inference requires either marginalization—resulting in dependence structures that prevent efficient computation via parallelization and conjugacy—or finite truncation, which arbitrarily limits the flexibility of the model. In this paper we present a novel Markov chain Monte Carlo algorithm for posterior inference that adaptively sets the truncation level using auxiliary slice variables, enabling efficient, parallelized computation without sacrificing flexibility. In contrast to past work that achieved this on a model-by-model basis, we provide a general recipe that is applicable to the broad class of completely random measure-based priors. The efficacy of the proposed algorithm is evaluated on several popular nonparametric models, demonstrating a higher effective sample size per second compared to algorithms using marginalization as well as a higher predictive performance compared to models employing fixed truncations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/27/2019

Nonnegative Bayesian nonparametric factor models with completely random measures for community detection

We present a Bayesian nonparametric Poisson factorization model for mode...
research
01/15/2018

Latent nested nonparametric priors

Discrete random structures are important tools in Bayesian nonparametric...
research
07/02/2015

Correlated Random Measures

We develop correlated random measures, random measures where the atom we...
research
01/15/2020

Distributed, partially collapsed MCMC for Bayesian Nonparametrics

Bayesian nonparametric (BNP) models provide elegant methods for discover...
research
11/20/2012

A unifying representation for a class of dependent random measures

We present a general construction for dependent random measures based on...
research
05/19/2017

Accelerated Inference for Latent Variable Models

Inference of latent feature models in the Bayesian nonparametric setting...
research
09/22/2021

Bayesian Nonparametric Modelling of Conditional Multidimensional Dependence Structures

In recent years, conditional copulas, that allow dependence between vari...

Please sign up or login with your details

Forgot password? Click here to reset