Topic Modelling Meets Deep Neural Networks: A Survey

02/28/2021
by   He Zhao, et al.
0

Topic modelling has been a successful technique for text analysis for almost twenty years. When topic modelling met deep neural networks, there emerged a new and increasingly popular research area, neural topic models, with over a hundred models developed and a wide range of applications in neural language understanding such as text generation, summarisation and language models. There is a need to summarise research developments and discuss open problems and future directions. In this paper, we provide a focused yet comprehensive overview of neural topic models for interested researchers in the AI community, so as to facilitate them to navigate and innovate in this fast-growing research area. To the best of our knowledge, ours is the first review focusing on this specific topic.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/18/2020

Explainable and Discourse Topic-aware Neural Language Understanding

Marrying topic models and language models exposes language understanding...
research
03/01/2019

A Review of Stochastic Block Models and Extensions for Graph Clustering

There have been rapid developments in model-based clustering of graphs, ...
research
05/24/2022

A Survey on Neural Open Information Extraction: Current Status and Future Directions

Open Information Extraction (OpenIE) facilitates domain-independent disc...
research
03/24/2023

Overview of the ICASSP 2023 General Meeting Understanding and Generation Challenge (MUG)

ICASSP2023 General Meeting Understanding and Generation Challenge (MUG) ...
research
09/13/2023

Cognitive Mirage: A Review of Hallucinations in Large Language Models

As large language models continue to develop in the field of AI, text ge...
research
11/27/2020

MITAO: a tool for enabling scholars in the Humanities to use Topic Modelling in their studies

Automatic text analysis methods, such as Topic Modelling, are gaining mu...
research
06/12/2023

Point spread function modelling for astronomical telescopes: a review focused on weak gravitational lensing studies

The accurate modelling of the Point Spread Function (PSF) is of paramoun...

Please sign up or login with your details

Forgot password? Click here to reset