Log In Sign Up

Statement networks: a power structure narrative as depicted by newspapers

We report a data mining pipeline and subsequent analysis to understand the core periphery power structure created in three national newspapers in Bangladesh, as depicted by statements made by people appearing in news. Statements made by one actor about another actor can be considered a form of public conversation. Named entity recognition techniques can be used to create a temporal actor network from such conversations, which shows some unique structure, and reveals much room for improvement in news reporting and also the top actors' conversation preferences. Our results indicate there is a presence of cliquishness between powerful political leaders when it comes to their appearance in news. We also show how these cohesive cores form through the news articles, and how, over a decade, news cycles change the actors belonging in these groups.


page 1

page 2

page 3

page 4


Quantum Criticism: A Tagged News Corpus Analysed for Sentiment and Named Entities

In this research, we continuously collect data from the RSS feeds of tra...

What's The Latest? A Question-driven News Chatbot

This work describes an automatic news chatbot that draws content from a ...

Interpretability Analysis for Named Entity Recognition to Understand System Predictions and How They Can Improve

Named Entity Recognition systems achieve remarkable performance on domai...

KIND: an Italian Multi-Domain Dataset for Named Entity Recognition

In this paper we present KIND, an Italian dataset for Named-Entity Recog...

Assessing Partisan Traits of News Text Attributions

On the topic of journalistic integrity, the current state of accurate, i...

Similarity measure for Public Persons

For the webportal "Who is in the News!" with statistics about the appear...

1 Introduction

Machine Learning techniques like named entity recognition opened up many avenues of novel analysis on social media and newspapers. In this work, we take a different turn by using named entity recognition to identify highly mentioned actors in newspapers and create a network of them by parsing the statements they make about one another. Studying some properties of this unique network reveals some interesting characteristics that could be attributed to both the journalistic style of different newspapers and the culture of political statements in Bangladesh.

Previous works on newspaper text analysis looked at how a news outlet is biased towards particular political ideologies groseclose2005measure akhavan1998framing , or comparison between the writing style of different news outlets in different countries kirilenko2012computer . Additionally, there has been work on comparing newspapers in local, regional and national level snyder1977conflict and comparing information gathered from surveying people in the locality and related news articles martin2013network . In this paper we show that the political leaders appearing in Bangladeshi newspapers have a tendency to create statements about other powerful politicians.

2 Data acquisition and processing

Figure 1: Creation of statement network from news article

2.1 Scraping and tagging news

Three major English dailies, The Daily Star, Dhaka Tribune, and New Age, were scraped for this research. Necessary information, like news text, headline, date of publication, news category, etc. were obtained from all news sections. Information like breadcrumb, subheadings, taglines that were not consistently available across all three newspapers were ignored. The Daily Star data was obtained in the time range 2008-01-01 to 2017-12-01 (119 months), Dhaka Tribune data was obtained in the time range 2013-04-06 to 2016-06-14 (38 months), and New Age data was obtained in the time range 2016-10-01 to 2018-04-22 (18 months). Even though the time range wasn’t consistent across the newspapers, they could be compared because the volume of data from each newspaper was sufficient to form a large enough statement network and study the dynamics of network evolution.

2.2 NER and network formation

After scraping the three newspapers, a named-entity recognition (NER) tagger finkel2005incorporating was used to find all the person labels that appear in the news text. In some cases, some names or entities appeared to be broken up into two separate names. Some obvious ones that appeared frequently were fixed by concatenating the names. For example, if Barack and Obama were identified as two different people, they were considered as Barack Obama to maintain consistency and avoid repetition in the network.

Next, a statement network was created for each newspaper. In order to create it, each news text was searched for quotation marks and words like ‘said’, ‘asked’, ‘told’, ‘spoke’, ‘speak’, ‘says’, ‘added’, ‘declare’ and ‘alleged’ (and their inflected forms) to look for sentences that indicated a speech or a conversation. These sentences were chosen only if two or more entities tagged previously appeared in them. On random manual checking of the sentences, this method proved to be largely effective to select conversations among entities or about entities. An indirect statement network was then created among these entities by finding all possible combinations of entities that are identified as a person. For example, if entity A, B and C appeared together in one sentence, the combinations would be AB, BC and AC. The process of the creation of statement network is illustrated in 1.

3 Analysis of statement network and its dynamics

3.1 Core-periphery structure of news statement network

To investigate the power structure in a statement network, we compute its core-periphery hierarchy. Often time an investigation of the core-periphery structure reveals the tight cliques between people of elite status borgatti2000models alba1978elite . To identify the core-periphery structure in a network we use the k-core algorithm wasserman1994social . To be included in k-core, a node has to be connected to at least k other nodes in the group. This measure helps identify the tightly connected groups within the network.

Figure 2: Evolution of the members in top core in Dhaka Tribune

The investigation of top cores revealed an interesting picture. After manual inspection of the actors appearing in the topmost cores, we identified them as political elite people such as the Prime Minister, opposition leader, ministers, top members of different political parties, etc. The number of cores are 9, 35 and 39 respectively for Dhaka Tribune, New Age, and The Daily Star.

This led us to investigate of how such a top core was formed and how it evolved over time. Figure 2 shows an example of a top core’s evolution in Dhaka Tribune. There are nine people in the top core (the 9 curves in figure 2). We track how their core rank changes over 38 months. A cumulative statement network for a month x was formed by adding all the edges that appeared up to month x. On the 38th month, we get an accumulated network in this way (that we used to calculate the core periphery hierarchy above). Additionally, we investigated the monthly core periphery structure by accumulating the edges created from daily news over one-month periods.

In the cumulative network, we noticed a sudden phase transition at the 27th month that forms the top core. We noticed that these people tend to frequently appear together in different news and ultimately fall in the same core because of such a transition. The monthly network’s core ranks reveal that they all appeared together in a few news on the 27th month. Thus the cumulative network retains all those edges and keeps them in the top core until the end.

3.2 Dynamics of news cycle

Figure 3: Evolution of overlap between actors in hierarchy buckets

The topics or persons that are covered in newspapers bucy2007media or internet leskovec2009meme change over time, which is generally known as news cycle. To understand the effect of news cycle on the top most cores, we created separate statement networks in The Daily Star for every 6 month period. We created a top most hierarchy bucket by collecting the nodes with core-number greater than 7 for each of these statement networks. Then we tracked the membership of these topmost hierarchy buckets over 21 six-month periods (10 years).

In Figure 3 we saw that the overlap, which was calculated as a percentage overlap between the topmost hierarchy bucket on 6 month intervals, between these buckets was not significantly high and it actually even diminishes over time. This shows that over a long period of time, as the news cycles change, the actors in the topmost cores change. So the cohesiveness of the top cores are affected by news cycle.

3.3 Newspapers’ conversational style

Figure 4: Daily edge count distribution for the newspapers

In Figure 4 we present the daily edge count distribution of the statement networks extracted from the newspapers. An edge was created in the network if an article connects two nodes (persons) through a conversation like sentence. Higher edge count on a particular day would indicate that the newspaper covered more conversational news on that day. From the daily edge count distribution we notice the difference between the conversational styles of the newspapers. Dhaka Tribune has a lot more days in the timeline where they have a lot less conversational articles (i.e., less number of statements made). In comparison to that, New Age has more conversations as the daily edge distribution starts from a lower value and flattens out soon. Both The Daily Star and New Age have long tails which show that on some days they have more than average conversational news published.

4 Discussion

A lack of statements made about general topics (such as development issues, governmental organizations etc.) is revealed in our investigation, as the most interconnected cores do not contain any other personalities other than top political leaders from government and opposition parties. This could be an artifact of how journalists cover an event (conversational style) in different newspapers, or a culture of political debates that do not usually take account of pressing issues. Causal relationships cannot be derived from the data that we have, but this work invites further development of machine learning pipelines (such as stance detection, Bangla named entity recognition for native language newspapers etc.) to investigate statement networks and public statements made by political leaders in Bangladesh.


  • (1) Akhavan-Majid, R., and Ramaprasad, J. Framing and ideology: A comparative analysis of us and chinese newspaper coverage of the fourth united nations conference on women an the ngo forum. Mass Communication and Society 1, 3-4 (1998), 131–152.
  • (2) Alba, R. D., and Moore, G. Elite social circles. Sociological Methods & Research 7, 2 (1978), 167–188.
  • (3) Borgatti, S. P., and Everett, M. G. Models of core/periphery structures. Social networks 21, 4 (2000), 375–395.
  • (4) Bucy, E. P., Gantz, W., and Wang, Z. Media technology and the 24-hour news cycle. Communication technology and social change: Theory and implications (2007), 143–163.
  • (5) Finkel, J. R., Grenager, T., and Manning, C. Incorporating non-local information into information extraction systems by gibbs sampling. In Proceedings of the 43rd annual meeting on association for computational linguistics (2005), Association for Computational Linguistics, pp. 363–370.
  • (6) Groseclose, T., and Milyo, J. A measure of media bias. The Quarterly Journal of Economics 120, 4 (2005), 1191–1237.
  • (7) Kirilenko, A., Stepchenkova, S., Romsdahl, R., and Mattis, K. Computer-assisted analysis of public discourse: A case study of the precautionary principle in the us and uk press. Quality & Quantity 46, 2 (2012), 501–522.
  • (8) Leskovec, J., Backstrom, L., and Kleinberg, J. Meme-tracking and the dynamics of the news cycle. In Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining (2009), ACM, pp. 497–506.
  • (9) Martin, M. K., Pfeffer, J., and Carley, K. M. Network text analysis of conceptual overlap in interviews, newspaper articles and keywords. Social Network Analysis and Mining 3, 4 (2013), 1165–1177.
  • (10) Snyder, D., and Kelly, W. R. Conflict intensity, media sensitivity and the validity of newspaper data. American Sociological Review (1977), 105–123.
  • (11) Wasserman, S., and Faust, K. Social network analysis: Methods and applications, vol. 8. Cambridge university press, 1994.