An Adaptation of Topic Modeling to Sentences

07/20/2016
by   Ruey-Cheng Chen, et al.
0

Advances in topic modeling have yielded effective methods for characterizing the latent semantics of textual data. However, applying standard topic modeling approaches to sentence-level tasks introduces a number of challenges. In this paper, we adapt the approach of latent-Dirichlet allocation to include an additional layer for incorporating information about the sentence boundaries in documents. We show that the addition of this minimal information of document structure improves the perplexity results of a trained model.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/25/2020

Gaussian Hierarchical Latent Dirichlet Allocation: Bringing Polysemy Back

Topic models are widely used to discover the latent representation of a ...
research
06/18/2020

Explainable and Discourse Topic-aware Neural Language Understanding

Marrying topic models and language models exposes language understanding...
research
01/05/2023

Topic Segmentation Model Focusing on Local Context

Topic segmentation is important in understanding scientific documents si...
research
10/14/2021

Neural Attention-Aware Hierarchical Topic Model

Neural topic models (NTMs) apply deep neural networks to topic modelling...
research
05/23/2013

A Supervised Neural Autoregressive Topic Model for Simultaneous Image Classification and Annotation

Topic modeling based on latent Dirichlet allocation (LDA) has been a fra...
research
07/16/2015

Exploratory topic modeling with distributional semantics

As we continue to collect and store textual data in a multitude of domai...
research
04/13/2022

Neural Topic Modeling of Psychotherapy Sessions

In this work, we compare different neural topic modeling methods in lear...

Please sign up or login with your details

Forgot password? Click here to reset