Truthful Information Elicitation from Hybrid Crowds

by   Qishen Han, et al.

Suppose a decision maker wants to predict weather tomorrow by eliciting and aggregating information from crowd. How can the decision maker incentivize the crowds to report their information truthfully? Many truthful peer prediction mechanisms have been proposed for homogeneous agents, whose types are drawn from the same distribution. However, in many situations, the population is a hybrid crowd of different types of agents with different forms of information, and the decision maker has neither the identity of any individual nor the proportion of each types of agents in the crowd. Ignoring the heterogeneity among the agent may lead to inefficient of biased information, which would in turn lead to suboptimal decisions. In this paper, we propose the first framework for information elicitation from hybrid crowds, and two mechanisms to motivate agents to report their information truthfully. The first mechanism combines two mechanisms via linear transformations and the second is based on mutual information. With two mechanisms, the decision maker can collect high quality information from hybrid crowds, and learns the expertise of agents.



There are no comments yet.


page 1

page 2

page 3

page 4


Sharing Information with Competitors

We study the mechanism design problem in the setting where agents are re...

Eliciting Expertise without Verification

A central question of crowd-sourcing is how to elicit expertise from age...

An Incentive Mechanism for Crowd Sensing with Colluding Agents

Vehicular mobile crowd sensing is a fast-emerging paradigm to collect da...

Infochain: A Decentralized System for Truthful Information Elicitation

Incentive mechanisms play a pivotal role in collecting correct and relia...

The Wisdom of the Crowd and Higher-Order Beliefs

The classic wisdom-of-the-crowd problem asks how a principal can "aggreg...

Optimizing Multi-task Peer Prediction

In the setting where we ask participants multiple similar possibly subje...

Truthful Data Acquisition via Peer Prediction

We consider the problem of purchasing data for machine learning or stati...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.