Eliciting Worker Preference for Task Completion

01/10/2018
by   Mohammadreza Esfandiari, et al.
0

Current crowdsourcing platforms provide little support for worker feedback. Workers are sometimes invited to post free text describing their experience and preferences in completing tasks. They can also use forums such as Turker Nation1 to exchange preferences on tasks and requesters. In fact, crowdsourcing platforms rely heavily on observing workers and inferring their preferences implicitly. In this work, we believe that asking workers to indicate their preferences explicitly improve their experience in task completion and hence, the quality of their contributions. Explicit elicitation can indeed help to build more accurate worker models for task completion that captures the evolving nature of worker preferences. We design a worker model whose accuracy is improved iteratively by requesting preferences for task factors such as required skills, task payment, and task relevance. We propose a generic framework, develop efficient solutions in realistic scenarios, and run extensive experiments that show the benefit of explicit preference elicitation over implicit ones with statistical significance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/19/2020

Creativity on Paid Crowdsourcing Platforms

General-purpose crowdsourcing platforms are increasingly being harnessed...
research
02/10/2016

Feature Based Task Recommendation in Crowdsourcing with Implicit Observations

Existing research in crowdsourcing has investigated how to recommend tas...
research
04/14/2019

Boomerang: Rebounding the Consequences of Reputation Feedback on Crowdsourcing Platforms

Paid crowdsourcing platforms suffer from low-quality work and unfair rej...
research
03/10/2019

Exploration of Interesting Dense Regions in Spatial Data

Nowadays, spatial data are ubiquitous in various fields of science, such...
research
03/27/2021

Two-Stage Clustering of Human Preferences for Action Prediction in Assembly Tasks

To effectively assist human workers in assembly tasks a robot must proac...
research
07/07/2022

Older Adults' Motivation and Engagement with Diverse Crowdsourcing Citizen Science Tasks

In this exploratory study we evaluated the engagement, performance and p...
research
01/24/2022

Using Computational Grounded Theory to Understand Tutors' Experiences in the Gig Economy

The introduction of online marketplace platforms has led to the advent o...

Please sign up or login with your details

Forgot password? Click here to reset