DeepAI AI Chat
Log In Sign Up

Study on Patterns and Effect of Task Diversity in Software Crowdsourcing

by   Denisse Martinez-Mejorado, et al.
Association for Computing Machinery
Stevens Institute of Technology

Context: The success of software crowdsourcing depends on steady tasks supply and active worker pool. Existing analysis reveals an average task failure ratio of 15.7 to empirically investigate patterns and effect of task diversity in software crowdsourcing platform in order to improve the success and efficiency of software crowdsourcing. Method: We propose a conceptual task diversity model, and develop an approach to measuring and analyzing task diversity.More specifically, this includes grouping similar tasks, ranking them based on their competition level and identifying the dominant attributes that distinguish among these levels, and then studying the impact of task diversity on task success and worker performance in crowdsourcing platform. The empirical study is conducted on more than one year's real-world data from TopCoder, the leading software crowdsourcing platform. Results: We identified that monetary prize and task complexity are the dominant attributes that differentiate among different competition levels. Based on these dominant attributes, we found three task diversity patterns (configurations) from workers behavior perspective: responsive to prize, responsive to prize and complexity and over responsive to prize. This study supports that1) responsive to prize configuration provides highest level of task density and workers' reliability in a platform; 2) responsive to prize and complexity configuration leads to attracting high level of trustworthy workers; 3) over responsive to prize configuration results in highest task stability and the lowest failure ratio in the platform for not high similar tasks.


Nobody of the Crowd: An Empirical Evaluation on Worker Clustering in Topcoder

Context: Software crowdsourcing platforms typically employ extrinsic rew...

Scheduling Tasks for Software Crowdsourcing Platforms to Reduce Task Failure

Context: Highly dynamic and competitive crowd-sourcing software developm...

From Zero to The Hero: A Collaborative Market Aware Recommendation System for Crowd Workers

The success of software crowdsourcing depends on active and trustworthy ...

CrowdSim: A Hybrid Simulation Model for Failure Prediction in Crowdsourced Software Development

A typical crowdsourcing software development(CSD) marketplace consists o...

Is This the Right Time to Post My Task? An Empirical Analysis on a Task Similarity Arrival in TopCoder

Existed studies have shown that crowd workers are more interested in tak...

Impact of Task Cycle Pattern on Project Success in Software Crowdsourcing

Crowdsourcing is becoming an accepted method of software development for...