Do Citations and Readership Identify Seminal Publications?

by   Drahomira Herrmannova, et al.

In this paper, we show that citation counts work better than a random baseline (by a margin of 10 Mendeley reader counts don't work better than the baseline. Specifically, we study the potential of these metrics for distinguishing publications that caused a change in a research field from those that have not. The experiment has been conducted on a new dataset for bibliometric research called TrueImpactDataset. TrueImpactDataset is a collection of research publications of two types -- research papers which are considered seminal works in their area and papers which provide a literature review of a research area. We provide overview statistics of the dataset and propose to use it for validating research evaluation metrics. Using the dataset, we conduct a set of experiments to study how citation and reader counts perform in distinguishing these publication types, following the intuition that causing a change in a field signifies research contribution. We show that citation counts help in distinguishing research that strongly influenced later developments from works that predominantly discuss the current state of the art with a degree of accuracy (63 reader counts perform worse than a random baseline.


page 1

page 2

page 3

page 4


Rank analysis of most cited publications, a new approach for research assessments

Citation metrics are the best tools for research assessments. However, c...

Going beneath the shoulders of giants: tracking the cumulative knowledge spreading in a comprehensive citation network

In all of science, the authors of publications depend on the knowledge p...

Do altmetrics correlate with the quality of papers? A large-scale empirical study based on F1000Prime data

In this study, we address the question whether (and to what extent, resp...

Pilaster: A Collection of Citation Metadata Extracted From Publications on Visualization for the Digital Humanities

In this paper, we present Pilaster (

Comparing People with Bibliometrics

Bibliometric indicators, citation counts and/or download counts are incr...

Please sign up or login with your details

Forgot password? Click here to reset