DeepAI AI Chat
Log In Sign Up

Truth Discovery via Proxy Voting

by   Reshef Meir, et al.
Rensselaer Polytechnic Institute

Truth discovery is a general name for a broad range of statistical methods aimed to extract the correct answers to questions, based on multiple answers coming from noisy sources. For example, workers in a crowdsourcing platform. In this paper, we design simple truth discovery methods inspired by proxy voting, that give higher weight to workers whose answers are close to those of other workers. We prove that under standard statistical assumptions, proxy-based truth discovery () allows us to estimate the true competence of each worker, whether workers face questions whose answers are real-valued, categorical, or rankings. We then demonstrate through extensive empirical study on synthetic and real data that is substantially better than unweighted aggregation, and competes well with other truth discovery methods, in all of the above domains.


page 12

page 17

page 28

page 32


Efficient Crowdsourcing via Proxy Voting

Crowdsourcing platforms offer a way to label data by aggregating answers...

Crowdsourced Truth Discovery in the Presence of Hierarchies for Knowledge Fusion

Existing works for truth discovery in categorical data usually assume th...

Incentivizing the Workers for Truth Discovery in Crowdsourcing with Copiers

Crowdsourcing has become an efficient paradigm for performing large scal...

Truth Inference on Sparse Crowdsourcing Data with Local Differential Privacy

Crowdsourcing has arisen as a new problem-solving paradigm for tasks tha...

Toward Effective Automated Content Analysis via Crowdsourcing

Many computer scientists use the aggregated answers of online workers to...

Truth Discovery with Memory Network

Truth discovery is to resolve conflicts and find the truth from multiple...

Sequential Multi-Class Labeling in Crowdsourcing

We consider a crowdsourcing platform where workers' responses to questio...