Managing sparsity, time, and quality of inference in topic models

10/26/2012
by   Khoat Than, et al.
0

Inference is an integral part of probabilistic topic models, but is often non-trivial to derive an efficient algorithm for a specific model. It is even much more challenging when we want to find a fast inference algorithm which always yields sparse latent representations of documents. In this article, we introduce a simple framework for inference in probabilistic topic models, denoted by FW. This framework is general and flexible enough to be easily adapted to mixture models. It has a linear convergence rate, offers an easy way to incorporate prior knowledge, and provides us an easy way to directly trade off sparsity against quality and time. We demonstrate the goodness and flexibility of FW over existing inference methods by a number of tasks. Finally, we show how inference in topic models with nonconjugate priors can be done efficiently.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/25/2017

A Neural Framework for Generalized Topic Models

Topic models for text corpora comprise a popular family of methods that ...
research
02/14/2012

Sparse Topical Coding

We present sparse topical coding (STC), a non-probabilistic formulation ...
research
12/10/2015

Guaranteed inference in topic models

One of the core problems in statistical models is the estimation of a po...
research
11/19/2017

Prior-aware Dual Decomposition: Document-specific Topic Inference for Spectral Topic Models

Spectral topic modeling algorithms operate on matrices/tensors of word c...
research
05/27/2016

Provable Algorithms for Inference in Topic Models

Recently, there has been considerable progress on designing algorithms w...
research
06/27/2012

Large Scale Variational Bayesian Inference for Structured Scale Mixture Models

Natural image statistics exhibit hierarchical dependencies across multip...
research
06/13/2012

Continuous Time Dynamic Topic Models

In this paper, we develop the continuous time dynamic topic model (cDTM)...

Please sign up or login with your details

Forgot password? Click here to reset