Emergent Instabilities in Algorithmic Feedback Loops

01/18/2022
by   Keith Burghardt, et al.
0

Algorithms that aid human tasks, such as recommendation systems, are ubiquitous. They appear in everything from social media to streaming videos to online shopping. However, the feedback loop between people and algorithms is poorly understood and can amplify cognitive and social biases (algorithmic confounding), leading to unexpected outcomes. In this work, we explore algorithmic confounding in collaborative filtering-based recommendation algorithms through teacher-student learning simulations. Namely, a student collaborative filtering-based model, trained on simulated choices, is used by the recommendation algorithm to recommend items to agents. Agents might choose some of these items, according to an underlying teacher model, with new choices then fed back into the student model as new training data (approximating online machine learning). These simulations demonstrate how algorithmic confounding produces erroneous recommendations which in turn lead to instability, i.e., wide variations in an item's popularity between each simulation realization. We use the simulations to demonstrate a novel approach to training collaborative filtering models that can create more stable and accurate recommendations. Our methodology is general enough that it can be extended to other socio-technical systems in order to better quantify and improve the stability of algorithms. These results highlight the need to account for emergent behaviors from interactions between people and algorithms.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/04/2020

Quantifying the Effects of Recommendation Systems

Recommendation systems today exert a strong influence on consumer behavi...
research
10/30/2017

How Algorithmic Confounding in Recommendation Systems Increases Homogeneity and Decreases Utility

Recommendation systems occupy an expanding role in everyday decision mak...
research
07/19/2019

Algorithmic Distortion of Informational Landscapes

The possible impact of algorithmic recommendation on the autonomy and fr...
research
09/02/2020

Neural Fair Collaborative Filtering

A growing proportion of human interactions are digitized on social media...
research
07/23/2019

Completing partial recipes using item-based collaborative filtering to recommend ingredients

Increased public interest in healthy lifestyles has motivated the study ...
research
11/13/2019

Collaborative Distillation for Top-N Recommendation

Knowledge distillation (KD) is a well-known method to reduce inference l...
research
11/17/2019

Adaptive Learning Guidance System (ALGS)

This poster presents the conceptual framework of the Adaptive Learning G...

Please sign up or login with your details

Forgot password? Click here to reset