Discriminative Topic Modeling with Logistic LDA

09/03/2019
by   Iryna Korshunova, et al.
17

Despite many years of research into latent Dirichlet allocation (LDA), applying LDA to collections of non-categorical items is still challenging. Yet many problems with much richer data share a similar structure and could benefit from the vast literature on LDA. We propose logistic LDA, a novel discriminative variant of latent Dirichlet allocation which is easy to apply to arbitrary inputs. In particular, our model can easily be applied to groups of images, arbitrary text embeddings, and integrate well with deep neural networks. Although it is a discriminative model, we show that logistic LDA can learn from unlabeled data in an unsupervised manner by exploiting the group structure present in the data. In contrast to other recent topic models designed to handle arbitrary inputs, our model does not sacrifice the interpretability and principled motivation of LDA.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 8

11/10/2014

Modeling Word Relatedness in Latent Dirichlet Allocation

Standard LDA model suffers the problem that the topic assignment of each...
08/05/2015

Learning from LDA using Deep Neural Networks

Latent Dirichlet Allocation (LDA) is a three-level hierarchical Bayesian...
08/07/2019

The Hitchhiker's Guide to LDA

Latent Dirichlet Allocation (LDA) model is a famous model in the topic m...
09/11/2021

Microbiome subcommunity learning with logistic-tree normal latent Dirichlet allocation

Mixed-membership (MM) models such as Latent Dirichlet Allocation (LDA) h...
12/16/2014

Application of Topic Models to Judgments from Public Procurement Domain

In this work, automatic analysis of themes contained in a large corpora ...
11/23/2020

LaHAR: Latent Human Activity Recognition using LDA

Processing sequential multi-sensor data becomes important in many tasks ...
12/09/2020

EvaLDA: Efficient Evasion Attacks Towards Latent Dirichlet Allocation

As one of the most powerful topic models, Latent Dirichlet Allocation (L...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.