Pareto-Optimal Fairness-Utility Amortizations in Rankings with a DBN Exposure Model

05/16/2022
by   Till Kletti, et al.
0

In recent years, it has become clear that rankings delivered in many areas need not only be useful to the users but also respect fairness of exposure for the item producers. We consider the problem of finding ranking policies that achieve a Pareto-optimal tradeoff between these two aspects. Several methods were proposed to solve it; for instance a popular one is to use linear programming with a Birkhoff-von Neumann decomposition. These methods, however, are based on a classical Position Based exposure Model (PBM), which assumes independence between the items (hence the exposure only depends on the rank). In many applications, this assumption is unrealistic and the community increasingly moves towards considering other models that include dependences, such as the Dynamic Bayesian Network (DBN) exposure model. For such models, computing (exact) optimal fair ranking policies remains an open question. We answer this question by leveraging a new geometrical method based on the so-called expohedron proposed recently for the PBM (Kletti et al., WSDM'22). We lay out the structure of a new geometrical object (the DBN-expohedron), and propose for it a Carathéodory decomposition algorithm of complexity O(n^3), where n is the number of documents to rank. Such an algorithm enables expressing any feasible expected exposure vector as a distribution over at most n rankings; furthermore we show that we can compute the whole set of Pareto-optimal expected exposure vectors with the same complexity O(n^3). Our work constitutes the first exact algorithm able to efficiently find a Pareto-optimal distribution of rankings. It is applicable to a broad range of fairness notions, including classical notions of meritocratic and demographic fairness. We empirically evaluate our method on the TREC2020 and MSLR datasets and compare it to several baselines in terms of Pareto-optimality and speed.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/07/2022

Introducing the Expohedron for Efficient Pareto-optimal Fairness-Utility Amortizations in Repeated Rankings

We consider the problem of computing a sequence of rankings that maximiz...
research
05/25/2022

Fairness of Exposure in Light of Incomplete Exposure Estimation

Fairness of exposure is a commonly used notion of fairness for ranking s...
research
06/21/2023

Sampling Individually-Fair Rankings that are Always Group Fair

Rankings on online platforms help their end-users find the relevant info...
research
04/29/2023

Learning to Re-rank with Constrained Meta-Optimal Transport

Many re-ranking strategies in search systems rely on stochastic ranking ...
research
02/11/2019

Policy Learning for Fairness in Ranking

Conventional Learning-to-Rank (LTR) methods optimize the utility of the ...
research
11/19/2019

Fair Learning-to-Rank from Implicit Feedback

Addressing unfairness in rankings has become an increasingly important p...
research
08/22/2023

(Un)fair Exposure in Deep Face Rankings at a Distance

Law enforcement regularly faces the challenge of ranking suspects from t...

Please sign up or login with your details

Forgot password? Click here to reset