How Reliable are University Rankings?

by   Ali Dasdan, et al.

University or college rankings have almost become an industry of their own, published by US News & World Report (USNWR) and similar organizations. Most of the rankings use a similar scheme: Rank universities in decreasing score order, where each score is computed using a set of attributes and their weights; the attributes can be objective or subjective while the weights are always subjective. This scheme is general enough to be applied to ranking objects other than universities. As shown in the related work, these rankings have important implications and also many issues. In this paper, we take a fresh look at this ranking scheme using the public College dataset; we both formally and experimentally show in multiple ways that this ranking scheme is not reliable and cannot be trusted as authoritative because it is too sensitive to weight changes and can easily be gamed. For example, we show how to derive reasonable weights programmatically to move multiple universities in our dataset to the top rank; moreover, this task takes a few seconds for over 600 universities on a personal laptop. Our mathematical formulation, methods, and results are applicable to ranking objects other than universities too. We conclude by making the case that all the data and methods used for rankings should be made open for validation and repeatability.


page 1

page 2

page 3

page 4


A Longitudinal Analysis of University Rankings

In this paper the ARWU, THE and QS global university rankings are studie...

Detect influential points of feature rankings

Background Deriving feature rankings is essential in bioinformatics stud...

Do the technical universities exhibit distinct behaviour in global university rankings? A Times Higher Education (THE) case study

Technical Universities (TUs) exhibit a distinct ranking performance in c...

On Obtaining Stable Rankings

We often have to rank items with multiple attributes in a dataset. A typ...

Data Driven and Visualization based Strategization for University Rank Improvement using Decision Trees

Annual ranking of higher educational institutes (HEIs) is a global pheno...

Nonlocal PageRank

In this work we introduce and study a nonlocal version of the PageRank. ...

Learning to Rank based on Analogical Reasoning

Object ranking or "learning to rank" is an important problem in the real...

Please sign up or login with your details

Forgot password? Click here to reset