Computing a consensus journal meta-ranking using paired comparisons and adaptive lasso estimators

04/19/2015
by   Laura Vana, et al.
0

In a "publish-or-perish culture", the ranking of scientific journals plays a central role in assessing performance in the current research environment. With a wide range of existing methods and approaches to deriving journal rankings, meta-rankings have gained popularity as a means of aggregating different information sources. In this paper, we propose a method to create a consensus meta-ranking using heterogeneous journal rankings. Using a parametric model for paired comparison data we estimate quality scores for 58 journals in the OR/MS community, which together with a shrinkage procedure allows for the identification of clusters of journals with similar quality. The use of paired comparisons provides a flexible framework for deriving a consensus score while eliminating the problem of data missingness.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/27/2017

Consensus measure of rankings

A ranking is an ordered sequence of items, in which an item with higher ...
research
05/30/2019

Quantifying consensus of rankings based on q-support patterns

Rankings, representing preferences over a set of candidates, are widely ...
research
01/07/2022

A Unified Statistical Learning Model for Rankings and Scores with Application to Grant Panel Review

Rankings and scores are two common data types used by judges to express ...
research
06/29/2021

When standard network measures fail to rank journals: A theoretical and empirical analysis

Journal rankings are widely used and are often based on citation data in...
research
02/23/2023

CrowDC: A Divide-and-Conquer Approach for Paired Comparisons in Crowdsourcing

Ranking a set of samples based on subjectivity, such as the experience q...
research
06/20/2012

Consensus ranking under the exponential model

We analyze the generalized Mallows model, a popular exponential model ov...
research
02/19/2018

As you like it: Localization via paired comparisons

Suppose that we wish to estimate a vector x from a set of binary paired ...

Please sign up or login with your details

Forgot password? Click here to reset