Auto-Encoding Variational Bayes for Inferring Topics and Visualization

10/19/2020
by   Dang Pham, et al.
0

Visualization and topic modeling are widely used approaches for text analysis. Traditional visualization methods find low-dimensional representations of documents in the visualization space (typically 2D or 3D) that can be displayed using a scatterplot. In contrast, topic modeling aims to discover topics from text, but for visualization, one needs to perform a post-hoc embedding using dimensionality reduction methods. Recent approaches propose using a generative model to jointly find topics and visualization, allowing the semantics to be infused in the visualization space for a meaningful interpretation. A major challenge that prevents these methods from being used practically is the scalability of their inference algorithms. We present, to the best of our knowledge, the first fast Auto-Encoding Variational Bayes based inference method for jointly inferring topics and visualization. Since our method is black box, it can handle model changes efficiently with little mathematical rederivation effort. We demonstrate the efficiency and effectiveness of our method on real-world large datasets and compare it with existing baselines.

READ FULL TEXT

page 8

page 9

research
06/09/2016

Generative Topic Embedding: a Continuous Representation of Documents (Extended Version with Proofs)

Word embedding maps words into a low-dimensional continuous embedding sp...
research
05/01/2019

Nested Variational Autoencoder for Topic Modeling on Microtexts with Word Vectors

Most of the information on the Internet is represented in the form of mi...
research
06/01/2017

Discovering Discrete Latent Topics with Neural Variational Inference

Topic models have been widely explored as probabilistic generative model...
research
10/27/2021

TopicNet: Semantic Graph-Guided Topic Discovery

Existing deep hierarchical topic models are able to extract semantically...
research
06/07/2021

Network-based Trajectory Topic Interaction Map for Text Mining of COVID-19 Biomedical Literature

Since the emergence of the worldwide pandemic of COVID-19, relevant rese...
research
01/16/2018

ProvThreads: Analytic Provenance Visualization and Segmentation

Our work aims to generate visualizations to enable meta-analysis of anal...
research
05/22/2018

Information Constraints on Auto-Encoding Variational Bayes

Parameterizing the approximate posterior of a generative model with neur...

Please sign up or login with your details

Forgot password? Click here to reset