Investigating Disagreement in the Scientific Literature

by   Wout S. Lamers, et al.

Disagreement is essential to scientific progress. However, the extent of disagreement in science, its evolution over time, and the fields in which it happens, remains poorly understood. Leveraging a massive collection of English-language scientific texts, we develop a cue-phrase based approach to identify instances of disagreement citations across more than four million scientific articles. Using this method, we construct an indicator of disagreement across scientific fields over the 2000-2015 period. In contrast with black-box text classification methods, our framework is transparent and easily interpretable. We reveal a disciplinary spectrum of disagreement, with higher disagreement in the social sciences and lower disagreement in physics and mathematics. However, detailed disciplinary analysis demonstrates heterogeneity across sub-fields, revealing the importance of local disciplinary cultures and epistemic characteristics of disagreement. Paper-level analysis reveals notable episodes of disagreement in science, and illustrates how methodological artifacts can confound analyses of scientific texts. These findings contribute to a broader understanding of disagreement and establish a foundation for future research to understanding key processes underlying scientific progress.



There are no comments yet.


page 10

page 12

page 36

page 37

page 39


Characterizing in-text citations in scientific articles: A large-scale analysis

We report characteristics of in-text citations in over five million full...

A note on comparison of scientific impact expressed by the number of citations in different fields of science

Citation distributions for 1992, 1994, 1996, 1997, 1999, and 2001, which...

Combining dissimilarity measure for the study of evolution in scientific fields

The evolution of scientific fields has been attracting much attention in...

Semantic Analysis for Automated Evaluation of the Potential Impact of Research Articles

Can the analysis of the semantics of words used in the text of a scienti...

The Arc of the Data Scientific Universe

In this paper I explore the scaffolding of normative assumptions that su...

The evolution of knowledge within and across fields in modern physics

The exchange of knowledge across different areas and disciplines plays a...

Mapping Three Decades of Intellectual Change in Academia

Research on the development of science has focused on the creation of mu...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.