Geometric Dirichlet Means algorithm for topic inference

10/27/2016
by   Mikhail Yurochkin, et al.
0

We propose a geometric algorithm for topic learning and inference that is built on the convex geometry of topics arising from the Latent Dirichlet Allocation (LDA) model and its nonparametric extensions. To this end we study the optimization of a geometric loss function, which is a surrogate to the LDA's likelihood. Our method involves a fast optimization based weighted clustering procedure augmented with geometric corrections, which overcomes the computational and statistical inefficiencies encountered by other techniques based on Gibbs sampling and variational inference, while achieving the accuracy comparable to that of a Gibbs sampler. The topic estimates produced by our method are shown to be statistically consistent under some conditions. The algorithm is evaluated with extensive experiments on simulated and real data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/04/2017

Autoencoding Variational Inference For Topic Models

Topic models are one of the most popular methods for learning representa...
research
10/09/2017

Conic Scan-and-Cover algorithms for nonparametric topic modeling

We propose new algorithms for topic modeling when the number of topics i...
research
05/27/2019

Dirichlet Simplex Nest and Geometric Inference

We propose Dirichlet Simplex Nest, a class of probabilistic models suita...
research
10/22/2015

A 'Gibbs-Newton' Technique for Enhanced Inference of Multivariate Polya Parameters and Topic Models

Hyper-parameters play a major role in the learning and inference process...
research
10/10/2019

Learning beyond Predefined Label Space via Bayesian Nonparametric Topic Modelling

In real world machine learning applications, testing data may contain so...
research
05/01/2017

Stochastic Divergence Minimization for Biterm Topic Model

As the emergence and the thriving development of social networks, a huge...
research
09/24/2018

Streaming dynamic and distributed inference of latent geometric structures

We develop new models and algorithms for learning the temporal dynamics ...

Please sign up or login with your details

Forgot password? Click here to reset