Rank analysis of most cited publications, a new approach for research assessments

07/06/2023
by   Alonso Rodriguez-Navarro, et al.
0

Citation metrics are the best tools for research assessments. However, current metrics are misleading in research systems that pursue simultaneously different goals, such as the advance of science and incremental innovations, because their publications have different citation distributions. We estimate the contribution to the progress of knowledge by studying only a limited number of the most cited papers, which are dominated by publications pursuing this progress. To field-normalize the metrics, we substitute the number of citations by the rank position of papers from one country in the global list of papers. Using synthetic series of lognormally distributed numbers, we developed the Rk-index, which is calculated from the global ranks of the 10 highest numbers in each series, and demonstrate its equivalence to the number of papers in top percentiles, P top 0.1 and easy to calculate, and evaluates the contribution to the progress of knowledge much better than commonly used metrics. Although further research is needed, rank analysis of the most cited papers is a promising approach for research evaluation. It is also demonstrated that, for this purpose, domestic and collaborative papers should be studied independently.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/01/2017

Research assessment by percentile-based double rank analysis

In the double rank analysis of research publications, the local rank pos...
research
02/13/2018

Do Citations and Readership Identify Seminal Publications?

In this paper, we show that citation counts work better than a random ba...
research
02/09/2021

The Boundary-Spanning Mechanisms of Nobel Prize Winning Papers

The breakthrough potentials of research papers can be explained by their...
research
08/15/2023

Synergi: A Mixed-Initiative System for Scholarly Synthesis and Sensemaking

Efficiently reviewing scholarly literature and synthesizing prior art ar...
research
06/18/2021

Anomalous diffusion in the citation time series of scientific publications

We analyze the citation time-series of manuscripts in three different fi...
research
01/11/2022

The extreme upper tail of Japan's citation distribution reveals its research success

A number of indications, such as the number of Nobel Prize winners, show...
research
07/03/2018

The USA is an indisputable world leader in medical and biotechnological research

A country's research success can be assessed from the power law function...

Please sign up or login with your details

Forgot password? Click here to reset