ATM:Adversarial-neural Topic Model

11/01/2018
by   Rui Wang, et al.
0

Topic models are widely used for thematic structure discovery in text. But traditional topic models often require dedicated inference procedures for specific tasks at hand. Also, they are not designed to generate word-level semantic representations. To address these limitations, we propose a topic modeling approach based on Generative Adversarial Nets (GANs), called Adversarial-neural Topic Model (ATM). The proposed ATM models topics with Dirichlet prior and employs a generator network to capture the semantic patterns among latent topics. Meanwhile, the generator could also produce word-level semantic representations. To illustrate the feasibility of porting ATM to tasks other than topic modeling, we apply ATM for open domain event extraction. Our experimental results on the two public corpora show that ATM generates more coherence topics, outperforming a number of competitive baselines. Moreover, ATM is able to extract meaningful events from news articles.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/26/2020

Neural Topic Modeling with Bidirectional Adversarial Training

Recent years have witnessed a surge of interests of using neural topic m...
research
08/25/2019

Open Event Extraction from Online Text using a Generative Adversarial Network

To extract the structured representations of open-domain events, Bayesia...
research
05/28/2021

A Query-Driven Topic Model

Topic modeling is an unsupervised method for revealing the hidden semant...
research
03/25/2021

Term-community-based topic detection with variable resolution

Network-based procedures for topic detection in huge text collections of...
research
10/18/2016

Modeling community structure and topics in dynamic text networks

The last decade has seen great progress in both dynamic network modeling...
research
11/29/2016

Less is More: Learning Prominent and Diverse Topics for Data Summarization

Statistical topic models efficiently facilitate the exploration of large...
research
07/16/2015

Exploratory topic modeling with distributional semantics

As we continue to collect and store textual data in a multitude of domai...

Please sign up or login with your details

Forgot password? Click here to reset