DeepAI AI Chat
Log In Sign Up

Examining the Impact of Algorithm Awareness on Wikidata's Recommender System Recoin

by   Jesse Josua Benjamin, et al.

The global infrastructure of the Web, designed as an open and transparent system, has a significant impact on our society. However, algorithmic systems of corporate entities that neglect those principles increasingly populated the Web. Typical representatives of these algorithmic systems are recommender systems that influence our society both on a scale of global politics and during mundane shopping decisions. Recently, such recommender systems have come under critique for how they may strengthen existing or even generate new kinds of biases. To this end, designers and engineers are increasingly urged to make the functioning and purpose of recommender systems more transparent. Our research relates to the discourse of algorithm awareness, that reconsiders the role of algorithm visibility in interface design. We conducted online experiments with 105 participants using MTurk for the recommender system Recoin, a gadget for Wikidata. In these experiments, we presented users with one of a set of three different designs of Recoin's user interface, each of them exhibiting a varying degree of explainability and interactivity. Our findings include a positive correlation between comprehension of and trust in an algorithmic system in our interactive redesign. However, our results are not conclusive yet, and suggest that the measures of comprehension, fairness, accuracy and trust are not yet exhaustive for the empirical study of algorithm awareness. Our qualitative insights provide a first indication for further measures. Our study participants, for example, were less concerned with the details of understanding an algorithmic calculation than with who or what is judging the result of the algorithm.


page 1

page 2

page 3

page 4


Dynamic Adaptation of User Preferences and Results in a Destination Recommender System

Studying human factors has gained a lot of interest in recommender syste...

Exploring User Opinions of Fairness in Recommender Systems

Algorithmic fairness for artificial intelligence has become increasingly...

On Stackelberg Signaling and its Impact on Receiver's Trust in Personalized Recommender Systems

Recommender systems have relied on many intelligent technologies (e.g. m...

Inclusive Ethical Design for Recommender Systems

Recommender systems are becoming increasingly central as mediators of in...

Fighting Fire with Fire: Using Antidote Data to Improve Polarization and Fairness of Recommender Systems

The increasing role of recommender systems in many aspects of society ma...

A Survey of Research on Fair Recommender Systems

Recommender systems can strongly influence which information we see onli...

A Model for Evaluating Algorithmic Systems Accountability

Algorithmic systems make decisions that have a great impact in our lives...