Dependent Hierarchical Normalized Random Measures for Dynamic Topic Modeling

06/18/2012
by   Changyou Chen, et al.
0

We develop dependent hierarchical normalized random measures and apply them to dynamic topic modeling. The dependency arises via superposition, subsampling and point transition on the underlying Poisson processes of these measures. The measures used include normalised generalised Gamma processes that demonstrate power law properties, unlike Dirichlet processes used previously in dynamic topic modeling. Inference for the model includes adapting a recently developed slice sampler to directly manipulate the underlying Poisson process. Experiments performed on news, blogs, academic and Twitter collections demonstrate the technique gives superior perplexity over a number of previous models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/18/2012

Theory of Dependent Hierarchical Normalized Random Measures

This paper presents theory for Normalized Random Measures (NRMs), Normal...
research
11/20/2012

A unifying representation for a class of dependent random measures

We present a general construction for dependent random measures based on...
research
03/21/2019

Exact slice sampler for Hierarchical Dirichlet Processes

We propose an exact slice sampler for Hierarchical Dirichlet process (HD...
research
06/27/2016

The Dependent Random Measures with Independent Increments in Mixture Models

When observations are organized into groups where commonalties exist amo...
research
10/25/2012

Nested Hierarchical Dirichlet Processes

We develop a nested hierarchical Dirichlet process (nHDP) for hierarchic...
research
10/16/2012

A Slice Sampler for Restricted Hierarchical Beta Process with Applications to Shared Subspace Learning

Hierarchical beta process has found interesting applications in recent y...
research
10/19/2021

Nonparametric Sparse Tensor Factorization with Hierarchical Gamma Processes

We propose a nonparametric factorization approach for sparsely observed ...

Please sign up or login with your details

Forgot password? Click here to reset