Reputation-based Incentive Protocols in Crowdsourcing Applications

08/10/2011
by   Yu Zhang, et al.
0

Crowdsourcing websites (e.g. Yahoo! Answers, Amazon Mechanical Turk, and etc.) emerged in recent years that allow requesters from all around the world to post tasks and seek help from an equally global pool of workers. However, intrinsic incentive problems reside in crowdsourcing applications as workers and requester are selfish and aim to strategically maximize their own benefit. In this paper, we propose to provide incentives for workers to exert effort using a novel game-theoretic model based on repeated games. As there is always a gap in the social welfare between the non-cooperative equilibria emerging when workers pursue their self-interests and the desirable Pareto efficient outcome, we propose a novel class of incentive protocols based on social norms which integrates reputation mechanisms into the existing pricing schemes currently implemented on crowdsourcing websites, in order to improve the performance of the non-cooperative equilibria emerging in such applications. We first formulate the exchanges on a crowdsourcing website as a two-sided market where requesters and workers are matched and play gift-giving games repeatedly. Subsequently, we study the protocol designer's problem of finding an optimal and sustainable (equilibrium) protocol which achieves the highest social welfare for that website. We prove that the proposed incentives protocol can make the website operate close to Pareto efficiency. Moreover, we also examine an alternative scenario, where the protocol designer aims at maximizing the revenue of the website and evaluate the performance of the optimal protocol.

READ FULL TEXT
research
12/28/2017

Rating Protocol Design for Extortion and Cooperation in the Crowdsourcing Contest Dilemma

Crowdsourcing has emerged as a paradigm for leveraging human intelligenc...
research
07/29/2019

Small Profits and Quick Returns: An Incentive Mechanism Design for IoT-based Crowdsourcing under Continuous Platform Competition

Crowdsourcing can be applied to the Internet-of-Things (IoT) systems to ...
research
12/28/2017

Game-Theoretic Design of Optimal Two-Sided Rating Protocols for Service Exchange Dilemma in Crowdsourcing

Despite the increasing popularity and successful examples of crowdsourci...
research
11/28/2022

Incentive-boosted Federated Crowdsourcing

Crowdsourcing is a favorable computing paradigm for processing computer-...
research
05/14/2019

Crowdsourcing Data Acquisition via Social Networks

We consider a requester who acquires a set of data (e.g. images) that is...
research
04/09/2018

On the Posted Pricing in Crowdsourcing: Power of Bonus

In practical crowdsourcing systems such as Amazon Mechanical Turk, poste...
research
02/14/2016

Embracing Error to Enable Rapid Crowdsourcing

Microtask crowdsourcing has enabled dataset advances in social science a...

Please sign up or login with your details

Forgot password? Click here to reset