On the Predictability of Utilizing Rank Percentile to Evaluate Scientific Impact

03/30/2021
by   Sen Tian, et al.
0

Bibliographic metrics are commonly utilized for evaluation purposes within academia, often in conjunction with other metrics. These metrics vary widely across fields and change with the seniority of the scholar; consequently, the only way to interpret these values is by comparison with other academics within the same field who are of similar seniority. Among the field- and time- normalized indicators, rank percentile has grown in popularity, and it is preferred over other types of indicators. In this paper, we propose and justify a novel rank percentile indicator for scholars. Furthermore, we emphasize on the time factor that is built into the rank percentile, and we demonstrate that the rank percentile is highly predictable. The publication percentile is highly stable over time, while the scholar percentile exhibits short-term stability and can be predicted via a simple linear regression model. More advanced models that utilize extensive lists of features offer slightly superior performance; however, the simplicity and interpretability of the simple model impose significant advantages over the additional complexity of other models.

READ FULL TEXT

page 11

page 12

page 20

page 21

page 24

page 25

page 26

page 27

research
01/04/2019

The convergent validity of several (field-normalized) bibliometric indicators: How well does I3 perform for impact measurement?

Recently, the integrated impact indicator (I3) indicator was introduced ...
research
04/10/2018

Methodological considerations on the use of the normalized impact in the Severo Ochoa and María de Maetzu programmes

In 2011, the programme for Severo Ochoa Centers of Excellence and María ...
research
11/20/2019

Do disruption index indicators measure what they propose to measure? The comparison of several indicator variants with assessments by peers

Recently, Wu, Wang, and Evans (2019) and Bu, Waltman, and Huang (2019) p...
research
08/13/2023

Optimizing Offensive Gameplan in the National Basketball Association with Machine Learning

Throughout the analytical revolution that has occurred in the NBA, the d...
research
10/30/2018

A comparison of university performance scores and ranks by MNCS and FSS

In a previous article of ours, we explained the reasons why the MNCS and...

Please sign up or login with your details

Forgot password? Click here to reset