Stochastic Rank Aggregation

by   Shuzi Niu, et al.

This paper addresses the problem of rank aggregation, which aims to find a consensus ranking among multiple ranking inputs. Traditional rank aggregation methods are deterministic, and can be categorized into explicit and implicit methods depending on whether rank information is explicitly or implicitly utilized. Surprisingly, experimental results on real data sets show that explicit rank aggregation methods would not work as well as implicit methods, although rank information is critical for the task. Our analysis indicates that the major reason might be the unreliable rank information from incomplete ranking inputs. To solve this problem, we propose to incorporate uncertainty into rank aggregation and tackle the problem in both unsupervised and supervised scenario. We call this novel framework stochastic rank aggregation (St.Agg for short). Specifically, we introduce a prior distribution on ranks, and transform the ranking functions or objectives in traditional explicit methods to their expectations over this distribution. Our experiments on benchmark data sets show that the proposed St.Agg outperforms the baselines in both unsupervised and supervised scenarios.



There are no comments yet.


page 8


Statistical Inference for Incomplete Ranking Data: The Case of Rank-Dependent Coarsening

We consider the problem of statistical inference for ranking data, speci...

Ranking via Sinkhorn Propagation

It is of increasing importance to develop learning methods for ranking. ...

Unsupervised Submodular Rank Aggregation on Score-based Permutations

Unsupervised rank aggregation on score-based permutations, which is wide...

The Lovasz-Bregman Divergence and connections to rank aggregation, clustering, and web ranking

We extend the recently introduced theory of Lovasz-Bregman (LB) divergen...

Ensemble Risk Modeling Method for Robust Learning on Scarce Data

In medical risk modeling, typical data are "scarce": they have relativel...

Monotone Retargeting for Unsupervised Rank Aggregation with Object Features

Learning the true ordering between objects by aggregating a set of exper...

Assessing the Benefits of Model Ensembles in Neural Re-Ranking for Passage Retrieval

Our work aimed at experimentally assessing the benefits of model ensembl...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.