Fairness and Diversity for Rankings in Two-Sided Markets

10/04/2020
by   Lequn Wang, et al.
0

Ranking items by their probability of relevance has long been the goal of conventional ranking systems. While this maximizes traditional criteria of ranking performance, there is a growing understanding that it is an oversimplification in online platforms that serve not only a diverse user population, but also the producers of the items. In particular, ranking algorithms are expected to be fair in how they serve all groups of users – not just the majority group – and they also need to be fair in how they divide exposure among the items. These fairness considerations can partially be met by adding diversity to the rankings, as done in several recent works, but we show in this paper that user fairness, item fairness and diversity are fundamentally different concepts. In particular, we find that algorithms that consider only one of the three desiderata can fail to satisfy and even harm the other two. To overcome this shortcoming, we present the first ranking algorithm that explicitly enforces all three desiderata. The algorithm optimizes user and item fairness as a convex optimization problem which can be solved optimally. From its solution, a ranking policy can be derived via a new Birkhoff-von Neumann decomposition algorithm that optimizes diversity. Beyond the theoretical analysis, we provide a comprehensive empirical evaluation on a new benchmark dataset to show the effectiveness of the proposed ranking algorithm on controlling the three desiderata and the interplay between them.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/15/2022

Fair Ranking as Fair Division: Impact-Based Individual Fairness in Ranking

Rankings have become the primary interface in two-sided online markets. ...
research
09/04/2023

Fair Ranking under Disparate Uncertainty

Ranking is a ubiquitous method for focusing the attention of human evalu...
research
05/29/2020

Controlling Fairness and Bias in Dynamic Learning-to-Rank

Rankings are the primary interface through which many online platforms m...
research
03/06/2023

Privacy-Preserving Fair Item Ranking

Users worldwide access massive amounts of curated data in the form of ra...
research
12/28/2017

Designing Fair Ranking Schemes

Items from a database are often ranked based on a combination of multipl...
research
05/31/2023

Decomposition and Interleaving for Variance Reduction of Post-click Metrics

In this study, we propose an efficient method for comparing the post-cli...
research
05/04/2018

Equity of Attention: Amortizing Individual Fairness in Rankings

Rankings of people and items are at the heart of selection-making, match...

Please sign up or login with your details

Forgot password? Click here to reset