Do altmetrics correlate with the quality of papers? A large-scale empirical study based on F1000Prime data

11/20/2017
by   Lutz Bornmann, et al.
0

In this study, we address the question whether (and to what extent, respectively) altmetrics are related to the scientific quality of papers (as measured by peer assessments). Only a few studies have previously investigated the relationship between altmetrics and assessments by peers. In the first step, we analyse the underlying dimensions of measurement for traditional metrics (citation counts) and altmetrics - by using principal component analysis (PCA) and factor analysis (FA). In the second step, we test the relationship between the dimensions and quality of papers (as measured by the post-publication peer-review system of F1000Prime assessments) - using regression analysis. The results of the PCA and FA show that altmetrics operate along different dimensions, whereas Mendeley counts are related to citation counts, and tweets form a separate dimension. The results of the regression analysis indicate that citation-based metrics and readership counts are significantly more related to quality, than tweets. This result on the one hand questions the use of Twitter counts for research evaluation purposes and on the other hand indicates potential use of Mendeley reader counts.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/31/2021

Long-term Scientific Impact Revisited

Citation based measures are widely used as quantitative proxies for subj...
research
02/13/2018

Do Citations and Readership Identify Seminal Publications?

In this paper, we show that citation counts work better than a random ba...
research
12/22/2017

Field- and time-normalization of data with many zeros: An empirical analysis using citation and Twitter data

Thelwall (2017a, 2017b) proposed a new family of field- and time-normali...
research
01/10/2018

On the Availability of ESO Data Papers on arXiv/astro-ph

Using the ESO Telescope Bibliography database telbib, we have investigat...
research
02/05/2018

Can your paper evade the editors axe? Towards an AI assisted peer review system

This work is an exploratory study of how we could progress a step toward...

Please sign up or login with your details

Forgot password? Click here to reset