A Practical Algorithm for Topic Modeling with Provable Guarantees

12/19/2012
by   Sanjeev Arora, et al.
0

Topic models provide a useful method for dimensionality reduction and exploratory data analysis in large text corpora. Most approaches to topic model inference have been based on a maximum likelihood objective. Efficient algorithms exist that approximate this objective, but they have no provable guarantees. Recently, algorithms have been introduced that provide provable bounds, but these algorithms are not practical because they are inefficient and not robust to violations of model assumptions. In this paper we present an algorithm for topic model inference that is both provable and practical. The algorithm produces results comparable to the best MCMC implementations while running orders of magnitude faster.

READ FULL TEXT

page 23

page 24

research
05/27/2016

Provable Algorithms for Inference in Topic Models

Recently, there has been considerable progress on designing algorithms w...
research
09/24/2018

Streaming dynamic and distributed inference of latent geometric structures

We develop new models and algorithms for learning the temporal dynamics ...
research
11/01/2016

Robust Spectral Inference for Joint Stochastic Matrix Factorization

Spectral inference provides fast algorithms and provable optimality for ...
research
07/17/2023

Large-Scale Evaluation of Topic Models and Dimensionality Reduction Methods for 2D Text Spatialization

Topic models are a class of unsupervised learning algorithms for detecti...
research
06/18/2019

Interactive Topic Modeling with Anchor Words

The formalism of anchor words has enabled the development of fast topic ...
research
02/21/2019

Approximate selective inference via maximum likelihood

We consider an approximate version of the conditional approach to select...
research
11/05/2017

Practical Data-Dependent Metric Compression with Provable Guarantees

We introduce a new distance-preserving compact representation of multi-d...

Please sign up or login with your details

Forgot password? Click here to reset