Topic modelling discourse dynamics in historical newspapers

11/20/2020
by   Jani Marjanen, et al.
0

This paper addresses methodological issues in diachronic data analysis for historical research. We apply two families of topic models (LDA and DTM) on a relatively large set of historical newspapers, with the aim of capturing and understanding discourse dynamics. Our case study focuses on newspapers and periodicals published in Finland between 1854 and 1917, but our method can easily be transposed to any diachronic data. Our main contributions are a) a combined sampling, training and inference procedure for applying topic models to huge and imbalanced diachronic text collections; b) a discussion on the differences between two topic models for this type of data; c) quantifying topic prominence for a period and thus a generalization of document-wise topic assignment to a discourse level; and d) a discussion of the role of humanistic interpretation with regard to analysing discourse dynamics through topic models.

READ FULL TEXT

page 8

page 10

research
05/01/2020

Automatic Discourse Segmentation: Review and Perspectives

Multilingual discourse parsing is a very prominent research topic. The f...
research
06/18/2020

Explainable and Discourse Topic-aware Neural Language Understanding

Marrying topic models and language models exposes language understanding...
research
09/29/2019

Lifelong Neural Topic Learning in Contextualized Autoregressive Topic Models of Language via Informative Transfers

Topic models such as LDA, DocNADE, iDocNADEe have been popular in docume...
research
08/19/2015

Fast, Flexible Models for Discovering Topic Correlation across Weakly-Related Collections

Weak topic correlation across document collections with different number...
research
12/31/2019

A Hybrid Framework for Topic Structure using Laughter Occurrences

Conversational discourse coherence depends on both linguistic and parali...
research
05/24/2023

Advancing Topic Segmentation and Outline Generation in Chinese Texts: The Paragraph-level Topic Representation, Corpus, and Benchmark

Topic segmentation and outline generation strive to divide a document in...
research
02/20/2020

Processing topical queries on images of historical newspaper pages

Historical newspapers are a source of research for the human and social ...

Please sign up or login with your details

Forgot password? Click here to reset