Practitioners Versus Users: A Value-Sensitive Evaluation of Current Industrial Recommender System Design

08/08/2022
by   Zhilong Chen, et al.
0

Recommender systems are playing an increasingly important role in alleviating information overload and supporting users' various needs, e.g., consumption, socialization, and entertainment. However, limited research focuses on how values should be extensively considered in industrial deployments of recommender systems, the ignorance of which can be problematic. To fill this gap, in this paper, we adopt Value Sensitive Design to comprehensively explore how practitioners and users recognize different values of current industrial recommender systems. Based on conceptual and empirical investigations, we focus on five values: recommendation quality, privacy, transparency, fairness, and trustworthiness. We further conduct in-depth qualitative interviews with 20 users and 10 practitioners to delve into their opinions about these values. Our results reveal the existence and sources of tensions between practitioners and users in terms of value interpretation, evaluation, and practice, which provide novel implications for designing more human-centric and value-sensitive recommender systems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/12/2023

Distributionally-Informed Recommender System Evaluation

Current practice for evaluating recommender systems typically focuses on...
research
07/22/2021

What are you optimizing for? Aligning Recommender Systems with Human Values

We describe cases where real recommender systems were modified in the se...
research
05/16/2023

Consumer-side Fairness in Recommender Systems: A Systematic Survey of Methods and Evaluation

In the current landscape of ever-increasing levels of digitalization, we...
research
03/02/2023

Effective Visualization and Analysis of Recommender Systems

Recommender system exists everywhere in the business world. From Goodrea...
research
05/27/2023

Choosing the Right Weights: Balancing Value, Strategy, and Noise in Recommender Systems

Many recommender systems are based on optimizing a linear weighting of d...
research
11/03/2014

Modelling serendipity in a computational context

Building on a survey of previous theories of serendipity and creativity,...
research
02/20/2023

Mysterious and Manipulative Black Boxes: A Qualitative Analysis of Perceptions on Recommender Systems

Recommender systems are used to provide relevant suggestions on various ...

Please sign up or login with your details

Forgot password? Click here to reset