Human Interaction with Recommendation Systems: On Bias and Exploration

03/01/2017
by   Sven Schmit, et al.
0

Recommendation systems rely on historical user data to provide suggestions. We propose an explicit and simple model for the interaction between users and recommendations provided by a platform, and relate this model to the multi-armed bandit literature. First, we show that this interaction leads to a bias in naive estimators due to selection effects. This bias leads to suboptimal outcomes, which we quantify in terms of linear regret. We end the first part by discussing ways to obtain unbiased estimates. The second part of this work considers exploration of alternatives. We show that although agents are myopic, agents' heterogeneous preferences ensure that recommendation systems 'learn' about all alternatives without explicitly incentivizing this exploration. This work provides new and practical insights relevant to a wide range of systems designed to help users make better decisions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/19/2019

Bayesian Exploration with Heterogeneous Agents

It is common in recommendation systems that users both consume and produ...
research
05/16/2019

Fiduciary Bandits

Recommendation systems often face exploration-exploitation tradeoffs: th...
research
02/14/2019

The Perils of Exploration under Competition: A Computational Modeling Approach

We empirically study the interplay between exploration and competition. ...
research
05/12/2022

Improving Sequential Query Recommendation with Immediate User Feedback

We propose an algorithm for next query recommendation in interactive dat...
research
02/14/2019

Competing Bandits: The Perils of Exploration under Competition

We empirically study the interplay between exploration and competition. ...
research
09/13/2020

Spoiled for Choice? Personalized Recommendation for Healthcare Decisions: A Multi-Armed Bandit Approach

Online healthcare communities provide users with various healthcare inte...
research
08/15/2019

A Bayesian Choice Model for Eliminating Feedback Loops

Self-reinforcing feedback loops in personalization systems are typically...

Please sign up or login with your details

Forgot password? Click here to reset