A New Correlation Coefficient for Aggregating Non-strict and Incomplete Rankings

01/23/2018
by   Adolfo R. Escobedo, et al.
0

We introduce a correlation coefficient that is specifically designed to deal with a variety of ranking formats including those containing non-strict (i.e., with-ties) and incomplete (i.e., null) preferences. The new measure, which can be regarded as a generalization of the seminal Kendall tau correlation coefficient, is proven to be equivalent to a recently developed axiomatic ranking distance. In an effort to further unify and enhance the two robust ranking methodologies, this work proves the equivalence an additional axiomatic-distance and correlation-coefficient pairing in the space of non-strict incomplete rankings. In particular, the bridging of these complementary theories reinforces the singular suitability of the featured correlation coefficient to solve the general consensus ranking problem. The latter premise is further bolstered by an accompanying set of experiments on random instances, which are generated via a herein developed sampling technique connected with the classic Mallows distribution of ranking data. To carry out the featured experiments we devise a specialized branch and bound algorithm that provides the full set of alternative optimal solutions efficiently. Applying the algorithm on the generated random instances reveals that the featured correlation coefficient yields consistently fewer alternative optimal solutions as data becomes noisier.

READ FULL TEXT
research
05/30/2019

Quantifying consensus of rankings based on q-support patterns

Rankings, representing preferences over a set of candidates, are widely ...
research
11/02/2020

Aggregating Incomplete and Noisy Rankings

We consider the problem of learning the true ordering of a set of altern...
research
01/04/2019

Testing for strict stationarity in a random coefficient autoregressive model

We propose a procedure to decide between the null hypothesis of (strict)...
research
09/01/2020

On The Usage Of Average Hausdorff Distance For Segmentation Performance Assessment: Hidden Bias When Used For Ranking

Average Hausdorff Distance (AVD) is a widely used performance measure to...
research
09/13/2021

The correlation coefficient between citation metrics and winning a Nobel or Abel Prize

Computing such correlation coefficient would be straightforward had we h...
research
06/06/2013

Bayesian Inference of Natural Rankings in Incomplete Competition Networks

Competition between a complex system's constituents and a corresponding ...
research
05/05/2020

Coronavirus and sports leagues: how to obtain a fair ranking if the season cannot resume?

Many sports leagues are played in a tightly scheduled round-robin format...

Please sign up or login with your details

Forgot password? Click here to reset