Multivariate Spearman's rho for aggregating ranks using copulas

10/16/2014
by   Justin Bedo, et al.
0

We study the problem of rank aggregation: given a set of ranked lists, we want to form a consensus ranking. Furthermore, we consider the case of extreme lists: i.e., only the rank of the best or worst elements are known. We impute missing ranks by the average value and generalise Spearman's ρ to extreme ranks. Our main contribution is the derivation of a non-parametric estimator for rank aggregation based on multivariate extensions of Spearman's ρ, which measures correlation between a set of ranked lists. Multivariate Spearman's ρ is defined using copulas, and we show that the geometric mean of normalised ranks maximises multivariate correlation. Motivated by this, we propose a weighted geometric mean approach for learning to rank which has a closed form least squares solution. When only the best or worst elements of a ranked list are known, we impute the missing ranks by the average value, allowing us to apply Spearman's ρ. Finally, we demonstrate good performance on the rank aggregation benchmarks MQ2007 and MQ2008.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/14/2016

Monotone Retargeting for Unsupervised Rank Aggregation with Object Features

Learning the true ordering between objects by aggregating a set of exper...
research
04/15/2021

Partition-Mallows Model and Its Inference for Rank Aggregation

Learning how to aggregate ranking lists has been an active research area...
research
11/25/2013

Learning Reputation in an Authorship Network

The problem of searching for experts in a given academic field is hugely...
research
05/26/2023

Aggregating over Dominated Points by Sorting, Scanning, Zip and Flat Maps

Prefix aggregation operation (also called scan), and its particular case...
research
04/15/2018

A Weighted Generalization of the Graham-Diaconis Inequality for Ranked List Similarity

The Graham-Diaconis inequality shows the equivalence between two well-kn...
research
04/23/2020

Transformation of Mean Opinion Scores to Avoid Misleading of Ranked based Statistical Techniques

The rank correlation coefficients and the ranked-based statistical tests...
research
10/11/2022

Vote'n'Rank: Revision of Benchmarking with Social Choice Theory

The development of state-of-the-art systems in different applied areas o...

Please sign up or login with your details

Forgot password? Click here to reset