Log In Sign Up

Random Isn't Always Fair: Candidate Set Imbalance and Exposure Inequality in Recommender Systems

by   Amanda Bower, et al.

Traditionally, recommender systems operate by returning a user a set of items, ranked in order of estimated relevance to that user. In recent years, methods relying on stochastic ordering have been developed to create "fairer" rankings that reduce inequality in who or what is shown to users. Complete randomization – ordering candidate items randomly, independent of estimated relevance – is largely considered a baseline procedure that results in the most equal distribution of exposure. In industry settings, recommender systems often operate via a two-step process in which candidate items are first produced using computationally inexpensive methods and then a full ranking model is applied only to those candidates. In this paper, we consider the effects of inequality at the first step and show that, paradoxically, complete randomization at the second step can result in a higher degree of inequality relative to deterministic ordering of items by estimated relevance scores. In light of this observation, we then propose a simple post-processing algorithm in pursuit of reducing exposure inequality that works both when candidate sets have a high level of imbalance and when they do not. The efficacy of our method is illustrated on both simulated data and a common benchmark data set used in studying fairness in recommender systems.


page 1

page 2

page 3

page 4


Distributed Online Learning in Social Recommender Systems

In this paper, we consider decentralized sequential decision making in d...

Fairness in the First Stage of Two-Stage Recommender Systems

Many large-scale recommender systems consist of two stages, where the fi...

Interplay between Upsampling and Regularization for Provider Fairness in Recommender Systems

Considering the impact of recommendations on item providers is one of th...

Recommender Systems Fairness Evaluation via Generalized Cross Entropy

Fairness in recommender systems has been considered with respect to sens...

Optimizing generalized Gini indices for fairness in rankings

There is growing interest in designing recommender systems that aim at b...

Towards Fair Personalization by Avoiding Feedback Loops

Self-reinforcing feedback loops are both cause and effect of over and/or...