Common bibliometric approaches fail to assess correctly the number of important scientific advances for most countries and institutions

11/27/2022
by   Alonso Rodriguez-Navarro, et al.
0

Although not explicitly declared, most research rankings of countries and institutions are supposed to reveal their contribution to the advancement of knowledge. However, such advances are based on very highly cited publications with very low frequency, which can only very exceptionally be counted with statistical reliability. Percentile indicators enable calculations of the probability or frequency of such rare publications using counts of much more frequent publications; the general rule is that rankings based on the number of top 10 rare publications that push the boundaries of knowledge. Japan and its universities are exceptions, as their frequent Nobel Prizes contradicts their low Ptop 10 research fields, the singularity of percentile indicators holds only for research groups that are homogeneous in their aims and efficiency. Correct calculations for ranking countries and institutions should add the results of their homogeneous groups, instead of considering all publications as a single set. Although based on Japan, our findings have a general character. Common predictions of scientific advances based on Ptop 10 than correct calculations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/30/2018

Ranking research institutions by the number of highly-cited articles per scientist

In the literature and on the Web we can readily find research excellence...
research
07/14/2019

Robust Archives Maximize Scientific Accessibility

We present a bibliographic analysis of Chandra, Hubble, and Spitzer publ...
research
09/06/2023

Measuring open access publications: a novel normalized open access indicator

The issue of open access (OA) to scientific publications is attracting g...
research
04/02/2021

Interpreting the outcomes of research assessments: a geometrical approach

Research evaluations and comparison of the assessments of academic insti...
research
05/12/2017

Is there agreement on the prestige of scholarly book publishers in the Humanities? DELPHI over survey results

Despite having an important role supporting assessment processes, critic...

Please sign up or login with your details

Forgot password? Click here to reset