Feedback Loop and Bias Amplification in Recommender Systems

07/25/2020
by   Masoud Mansoury, et al.
0

Recommendation algorithms are known to suffer from popularity bias; a few popular items are recommended frequently while the majority of other items are ignored. These recommendations are then consumed by the users, their reaction will be logged and added to the system: what is generally known as a feedback loop. In this paper, we propose a method for simulating the users interaction with the recommenders in an offline setting and study the impact of feedback loop on the popularity bias amplification of several recommendation algorithms. We then show how this bias amplification leads to several other problems such as declining the aggregate diversity, shifting the representation of users' taste over time and also homogenization of the users experience. In particular, we show that the impact of feedback loop is generally stronger for the users who belong to the minority group.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/31/2019

The Unfairness of Popularity Bias in Recommendation

Recommender systems are known to suffer from the popularity bias problem...
research
09/13/2021

Correcting the User Feedback-Loop Bias for Recommendation Systems

Selection bias is prevalent in the data for training and evaluating reco...
research
06/21/2023

Which Spurious Correlations Impact Reasoning in NLI Models? A Visual Interactive Diagnosis through Data-Constrained Counterfactuals

We present a human-in-the-loop dashboard tailored to diagnosing potentia...
research
04/18/2021

The Simpson's Paradox in the Offline Evaluation of Recommendation Systems

Recommendation systems are often evaluated based on user's interactions ...
research
02/03/2022

Learning from a Learning User for Optimal Recommendations

In real-world recommendation problems, especially those with a formidabl...
research
04/27/2020

Some people aren't worth listening to: periodically retraining classifiers with feedback from a team of end users

Document classification is ubiquitous in a business setting, but often t...
research
03/17/2023

Feedback Effect in User Interaction with Intelligent Assistants: Delayed Engagement, Adaption and Drop-out

With the growing popularity of intelligent assistants (IAs), evaluating ...

Please sign up or login with your details

Forgot password? Click here to reset