Should citations be field-normalized in evaluative bibliometrics? An empirical analysis based on propensity score matching

10/24/2019
by   Lutz Bornmann, et al.
0

Field-normalization of citations is bibliometric standard. Despite the observed differences in citation counts between fields, the question remains how strong fields influence citation rates beyond the effect of attributes or factors possibly influencing citations (FICs). We considered several FICs such as number of pages and number of co-authors in this study. We wondered whether there is a separate field-effect besides other effects (e.g., from numbers of pages and co-authors). To find an answer on the question in this study, we applied inverse-probability of treatment weighting (IPW). Using Web of Science data (a sample of 308,231 articles), we investigated whether mean differences among subject categories in citation rates still remain, even if the subject categories are made comparable in the field-related attributes (e.g., comparable of co-authors, comparable number of pages) by IPW. In a diagnostic step of our statistical analyses, we considered propensity scores as covariates in regression analyses to examine whether the differences between the fields in FICs vanish. The results revealed that the differences did not completely vanish but were strongly reduced. We received similar results when we calculated mean value differences of the fields after IPW representing the causal or unconfounded field effects on citations. However, field differences in citation rates remain. The results point out that field-normalization seems to be a prerequisite for citation analysis and cannot be replaced by the consideration of any set of FICs in citation analyses.

READ FULL TEXT
research
04/10/2023

Characteristics of LIS Research Articles Affecting Their Citation Impact

The paper analyses the citation impact of Library and Information Scienc...
research
08/15/2018

Google Scholar, Web of Science, and Scopus: a systematic comparison of citations in 252 subject categories

Despite citation counts from Google Scholar (GS), Web of Science (WoS), ...
research
02/01/2022

A discussion of measuring the top-1 percent most-highly cited publications: Quality and impact of Chinese papers

The top 1 percent most highly cited articles are watched closely as the ...
research
10/24/2017

On the differences between citations and altmetrics: An investigation of factors driving altmetrics vs. citations for Finnish articles

This study examines a range of factors associating with future citation ...

Please sign up or login with your details

Forgot password? Click here to reset