Byzantine Spectral Ranking

11/15/2022
by   Arnhav Datar, et al.
0

We study the problem of rank aggregation where the goal is to obtain a global ranking by aggregating pair-wise comparisons of voters over a set of items. We consider an adversarial setting where the voters are partitioned into two sets. The first set votes in a stochastic manner according to the popular score-based Bradley-Terry-Luce (BTL) model for pairwise comparisons. The second set comprises malicious Byzantine voters trying to deteriorate the ranking. We consider a strongly-adversarial scenario where the Byzantine voters know the BTL scores, the votes of the good voters, the algorithm, and can collude with each other. We first show that the popular spectral ranking based Rank-Centrality algorithm, though optimal for the BTL model, does not perform well even when a small constant fraction of the voters are Byzantine. We introduce the Byzantine Spectral Ranking Algorithm (and a faster variant of it), which produces a reliable ranking when the number of good voters exceeds the number of Byzantine voters. We show that no algorithm can produce a satisfactory ranking with probability > 1/2 for all BTL weights when there are more Byzantine voters than good voters, showing that our algorithm works for all possible population fractions. We support our theoretical results with experimental results on synthetic and real datasets to demonstrate the failure of the Rank-Centrality algorithm under several adversarial scenarios and how the proposed Byzantine Spectral Ranking algorithm is robust in obtaining good rankings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/20/2014

Spectral Ranking using Seriation

We describe a seriation algorithm for ranking a set of items given pairw...
research
09/08/2012

Rank Centrality: Ranking from Pair-wise Comparisons

The question of aggregating pair-wise comparisons to obtain a global ran...
research
04/05/2015

Sync-Rank: Robust Ranking, Constrained Ranking and Rank Aggregation via Eigenvector and Semidefinite Programming Synchronization

We consider the classic problem of establishing a statistical ranking of...
research
11/14/2019

Beyond Pairwise Comparisons in Social Choice: A Setwise Kemeny Aggregation Problem

In this paper, we advocate the use of setwise contests for aggregating a...
research
06/27/2022

Rankings from multimodal pairwise comparisons

The task of ranking individuals or teams, based on a set of comparisons ...
research
10/14/2020

Robust Ranking of Equivalent Algorithms via Relative Performance

In scientific computing, it is common that one target computation can be...
research
02/02/2022

Spectral Rank Monotonicity on Undirected Networks

We study the problem of score and rank monotonicity for spectral ranking...

Please sign up or login with your details

Forgot password? Click here to reset