On a Topic Model for Sentences

06/01/2016
by   Georgios Balikas, et al.
0

Probabilistic topic models are generative models that describe the content of documents by discovering the latent topics underlying them. However, the structure of the textual input, and for instance the grouping of words in coherent text spans such as sentences, contains much information which is generally lost with these models. In this paper, we propose sentenceLDA, an extension of LDA whose goal is to overcome this limitation by incorporating the structure of the text in the generative and inference processes. We illustrate the advantages of sentenceLDA by comparing it with LDA using both intrinsic (perplexity) and extrinsic (text classification) evaluation tasks on different text collections.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/02/2019

Short Text Classification Improved by Feature Space Extension

With the explosive development of mobile Internet, short text has been a...
research
03/01/2022

Topic Analysis for Text with Side Data

Although latent factor models (e.g., matrix factorization) obtain good p...
research
07/04/2016

Temporal Topic Analysis with Endogenous and Exogenous Processes

We consider the problem of modeling temporal textual data taking endogen...
research
10/16/2014

Graph-Sparse LDA: A Topic Model with Structured Sparsity

Originally designed to model text, topic modeling has become a powerful ...
research
08/19/2015

Fast, Flexible Models for Discovering Topic Correlation across Weakly-Related Collections

Weak topic correlation across document collections with different number...
research
05/17/2023

Large-Scale Text Analysis Using Generative Language Models: A Case Study in Discovering Public Value Expressions in AI Patents

Labeling data is essential for training text classifiers but is often di...
research
02/07/2016

Scalable Text Mining with Sparse Generative Models

The information age has brought a deluge of data. Much of this is in tex...

Please sign up or login with your details

Forgot password? Click here to reset