HyHTM: Hyperbolic Geometry based Hierarchical Topic Models

05/16/2023
by   Simra Shahid, et al.
0

Hierarchical Topic Models (HTMs) are useful for discovering topic hierarchies in a collection of documents. However, traditional HTMs often produce hierarchies where lowerlevel topics are unrelated and not specific enough to their higher-level topics. Additionally, these methods can be computationally expensive. We present HyHTM - a Hyperbolic geometry based Hierarchical Topic Models - that addresses these limitations by incorporating hierarchical information from hyperbolic geometry to explicitly model hierarchies in topic models. Experimental results with four baselines show that HyHTM can better attend to parent-child relationships among topics. HyHTM produces coherent topic hierarchies that specialise in granularity from generic higher-level topics to specific lowerlevel topics. Further, our model is significantly faster and leaves a much smaller memory footprint than our best-performing baseline.We have made the source code for our algorithm publicly accessible.

READ FULL TEXT

page 8

page 13

research
10/16/2022

HyperMiner: Topic Taxonomy Mining with Hyperbolic Embedding

Embedded topic models are able to learn interpretable topics even with l...
research
09/29/2020

Neural Topic Modeling with Cycle-Consistent Adversarial Training

Advances on deep generative models have attracted significant research i...
research
02/28/2013

Continuous-time Infinite Dynamic Topic Models

Topic models are probabilistic models for discovering topical themes in ...
research
09/07/2018

Coherence-Aware Neural Topic Modeling

Topic models are evaluated based on their ability to describe documents ...
research
11/22/2021

HTMOT : Hierarchical Topic Modelling Over Time

Over the years, topic models have provided an efficient way of extractin...
research
08/05/2015

Progressive EM for Latent Tree Models and Hierarchical Topic Detection

Hierarchical latent tree analysis (HLTA) is recently proposed as a new m...
research
01/19/2021

Analysis and tuning of hierarchical topic models based on Renyi entropy approach

Hierarchical topic modeling is a potentially powerful instrument for det...

Please sign up or login with your details

Forgot password? Click here to reset