A Coefficient of Determination for Probabilistic Topic Models

11/20/2019
by   Tommy Jones, et al.
0

This research proposes a new (old) metric for evaluating goodness of fit in topic models, the coefficient of determination, or R^2. Within the context of topic modeling, R^2 has the same interpretation that it does when used in a broader class of statistical models. Reporting R^2 with topic models addresses two current problems in topic modeling: a lack of standard cross-contextual evaluation metrics for topic modeling and ease of communication with lay audiences. The author proposes that R^2 should be reported as a standard metric when constructing topic models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/23/2023

Contextualized Topic Coherence Metrics

The recent explosion in work on neural topic modeling has been criticize...
research
01/12/2018

On the goodness-of-fit of generalized linear geostatistical models

We propose a generalization of Zhang's coefficient of determination to g...
research
05/03/2018

A Coefficient of Determination (R2) for Linear Mixed Models

Extensions of linear models are very commonly used in the analysis of bi...
research
05/18/2019

Automatic Evaluation of Local Topic Quality

Topic models are typically evaluated with respect to the global topic di...
research
05/21/2021

Have you tried Neural Topic Models? Comparative Analysis of Neural and Non-Neural Topic Models with Application to COVID-19 Twitter Data

Topic models are widely used in studying social phenomena. We conduct a ...
research
01/28/2019

A new evaluation framework for topic modeling algorithms based on synthetic corpora

Topic models are in widespread use in natural language processing and be...
research
10/31/2021

Conical Classification For Computationally Efficient One-Class Topic Determination

As the Internet grows in size, so does the amount of text based informat...

Please sign up or login with your details

Forgot password? Click here to reset