Crowdsourcing Feature Discovery via Adaptively Chosen Comparisons

03/31/2015
by   James Y. Zou, et al.
0

We introduce an unsupervised approach to efficiently discover the underlying features in a data set via crowdsourcing. Our queries ask crowd members to articulate a feature common to two out of three displayed examples. In addition we also ask the crowd to provide binary labels to the remaining examples based on the discovered features. The triples are chosen adaptively based on the labels of the previously discovered features on the data set. In two natural models of features, hierarchical and independent, we show that a simple adaptive algorithm, using "two-out-of-three" similarity queries, recovers all features with less labor than any nonadaptive algorithm. Experimental results validate the theoretical findings.

READ FULL TEXT
research
12/10/2019

Efficient crowdsourcing of crowd-generated microtasks

Allowing members of the crowd to propose novel microtasks for one anothe...
research
12/15/2021

Expert and Crowd-Guided Affect Annotation and Prediction

We employ crowdsourcing to acquire time-continuous affective annotations...
research
09/20/2021

Crowdsourcing Diverse Paraphrases for Training Task-oriented Bots

A prominent approach to build datasets for training task-oriented bots i...
research
01/31/2020

Crowdsourced Classification with XOR Queries: Fundamental Limits and An Efficient Algorithm

Crowdsourcing systems have emerged as an effective platform to label dat...
research
02/10/2016

Achieving Budget-optimality with Adaptive Schemes in Crowdsourcing

Crowdsourcing platforms provide marketplaces where task requesters can p...
research
02/03/2017

A Theoretical Analysis of First Heuristics of Crowdsourced Entity Resolution

Entity resolution (ER) is the task of identifying all records in a datab...
research
04/27/2015

Building Hierarchies of Concepts via Crowdsourcing

Hierarchies of concepts are useful in many applications from navigation ...

Please sign up or login with your details

Forgot password? Click here to reset