Partial Truthfulness in Minimal Peer Prediction Mechanisms with Limited Knowledge

11/17/2017
by   Goran Radanovic, et al.
0

We study minimal single-task peer prediction mechanisms that have limited knowledge about agents' beliefs. Without knowing what agents' beliefs are or eliciting additional information, it is not possible to design a truthful mechanism in a Bayesian-Nash sense. We go beyond truthfulness and explore equilibrium strategy profiles that are only partially truthful. Using the results from the multi-armed bandit literature, we give a characterization of how inefficient these equilibria are comparing to truthful reporting. We measure the inefficiency of such strategies by counting the number of dishonest reports that any minimal knowledge-bounded mechanism must have. We show that the order of this number is Θ( n), where n is the number of agents, and we provide a peer prediction mechanism that achieves this bound in expectation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/08/2022

Peer Prediction for Learning Agents

Peer prediction refers to a collection of mechanisms for eliciting infor...
research
07/25/2015

Truth Serums for Massively Crowdsourced Evaluation Tasks

A major challenge in crowdsourcing evaluation tasks like labeling object...
research
06/06/2021

The Limits of Multi-task Peer Prediction

Recent advances in multi-task peer prediction have greatly expanded our ...
research
08/27/2019

Infochain: A Decentralized System for Truthful Information Elicitation

Incentive mechanisms play a pivotal role in collecting correct and relia...
research
09/30/2020

Learning and Strongly Truthful Multi-Task Peer Prediction: A Variational Approach

Peer prediction mechanisms incentivize agents to truthfully report their...
research
03/03/2021

Optimizing Multi-task Peer Prediction

In the setting where we ask participants multiple similar possibly subje...
research
11/01/2019

Dominantly Truthful Multi-task Peer Prediction with a Constant Number of Tasks

In the setting where participants are asked multiple similar possibly su...

Please sign up or login with your details

Forgot password? Click here to reset