Measuring the academic reputation through citation networks via PageRank

The objective assessment of the prestige of an academic institution is a difficult and hotly debated task. In the last few years, different types of University Rankings have been proposed to quantify the excellence of different research institutions in the world. Albeit met with criticism in some cases, the relevance of university rankings is being increasingly acknowledged: indeed, rankings are having a major impact on the design of research policies, both at the institutional and governmental level. Yet, the debate on what rankings are exactly measuring is enduring. Here, we address the issue by measuring a quantitive and reliable proxy of the academic reputation of a given institution and by evaluating its correlation with different university rankings. Specifically, we study citation patterns among universities in five different Web of Science Subject Categories and use the algorithm on the five resulting citation networks. The rationale behind our work is that scientific citations are driven by the reputation of the reference so that the PageRank algorithm is expected to yield a rank which reflects the reputation of an academic institution in a specific field. Our results allow to quantifying the prestige of a set of institutions in a certain research field based only on hard bibliometric data. Given the volume of the data analysed, our findings are statistically robust and less prone to bias, at odds with ad--hoc surveys often employed by ranking bodies in order to attain similar results. Because our findings are found to correlate extremely well with the ARWU Subject rankings, the approach we propose in our paper may open the door to new, Academic Ranking methodologies that go beyond current methods by reconciling the qualitative evaluation of Academic Prestige with its quantitative measurements via publication impact.

READ FULL TEXT

page 8

page 9

page 13

page 15

research
11/05/2018

A sensitivity analysis of research institutions' productivity rankings to the time of citation observation

One of the critical issues in bibliometric research assessments is the t...
research
05/17/2019

Mining university rankings: Publication output and citation impact as their basis

World University rankings have become well-established tools that studen...
research
03/28/2023

Ranking mobility and impact inequality in early academic careers

How difficult is it for an early career academic to climb the ranks of t...
research
04/13/2020

Approximating percentage of academic traffic in the World Wide Web and rankings of countries based on academic traffic

The paper introduces a novel mechanism for approximating traffic of the ...
research
08/10/2020

The Role of Positive and Negative Citations in Scientific Evaluation

Quantifying the impact of scientific papers objectively is crucial for r...
research
11/14/2016

Feature Engineering and Ensemble Modeling for Paper Acceptance Rank Prediction

Measuring research impact and ranking academic achievement are important...
research
06/04/2018

Rigging Research Results by Manipulating Top Websites Rankings

Researchers often use rankings of popular websites when measuring securi...

Please sign up or login with your details

Forgot password? Click here to reset