A Generalized Hierarchical Nonnegative Tensor Decomposition

09/30/2021
by   Joshua Vendrow, et al.
18

Nonnegative matrix factorization (NMF) has found many applications including topic modeling and document analysis. Hierarchical NMF (HNMF) variants are able to learn topics at various levels of granularity and illustrate their hierarchical relationship. Recently, nonnegative tensor factorization (NTF) methods have been applied in a similar fashion in order to handle data sets with complex, multi-modal structure. Hierarchical NTF (HNTF) methods have been proposed, however these methods do not naturally generalize their matrix-based counterparts. Here, we propose a new HNTF model which directly generalizes a HNMF model special case, and provide a supervised extension. We also provide a multiplicative updates training method for this model. Our experimental results show that this model more naturally illuminates the topic hierarchy than previous HNMF and HNTF methods.

READ FULL TEXT
research
02/28/2023

Neural Nonnegative Matrix Factorization for Hierarchical Multilayer Topic Modeling

We introduce a new method based on nonnegative matrix factorization, Neu...
research
11/24/2022

Multi-scale Hybridized Topic Modeling: A Pipeline for Analyzing Unstructured Text Datasets via Topic Modeling

We propose a multi-scale hybridized topic modeling method to find hidden...
research
01/02/2020

On Large-Scale Dynamic Topic Modeling with Nonnegative CP Tensor Decomposition

There is currently an unprecedented demand for large-scale temporal data...
research
10/15/2020

Semi-supervised NMF Models for Topic Modeling in Learning Tasks

We propose several new models for semi-supervised nonnegative matrix fac...
research
10/04/2020

On Nonnegative Matrix and Tensor Decompositions for COVID-19 Twitter Dynamics

We analyze Twitter data relating to the COVID-19 pandemic using dynamic ...
research
12/01/2019

Topic-aware chatbot using Recurrent Neural Networks and Nonnegative Matrix Factorization

We propose a novel model for a topic-aware chatbot by combining the trad...
research
11/05/2021

Investigation of Topic Modelling Methods for Understanding the Reports of the Mining Projects in Queensland

In the mining industry, many reports are generated in the project manage...

Please sign up or login with your details

Forgot password? Click here to reset