Parallel Contests for Crowdsourcing Reviews: Existence and Quality of Equilibria

02/08/2022
by   Georgios Birmpas, et al.
0

Motivated by the intricacies of allocating treasury funds in blockchain settings, we study the problem of crowdsourcing reviews for many different proposals, in parallel. During the reviewing phase, every reviewer can select the proposals to write reviews for, as well as the quality of each review. The quality levels follow certain very coarse community guidelines and can have values such as 'excellent' or 'good'. Based on these scores and the distribution of reviews, every reviewer will receive some reward for their efforts. In this paper, we design a reward scheme and show that it always has pure Nash equilibria, for any set of proposals and reviewers. In addition, we show that these equilibria guarantee constant factor approximations for two natural metrics: the total quality of all reviews, as well as the fraction of proposals that received at least one review, compared to the optimal outcome.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/28/2023

The Contest Game for Crowdsourcing Reviews

We consider a contest game modelling a contest where reviews for m propo...
research
05/17/2022

Decentralised Update Selection with Semi-Strategic Experts

Motivated by governance models adopted in blockchain applications, we st...
research
09/15/2017

Crowdsourcing Paper Screening in Systematic Literature Reviews

Literature reviews allow scientists to stand on the shoulders of giants,...
research
06/19/2020

Representing Pure Nash Equilibria in Argumentation

In this paper we describe an argumentation-based representation of norma...
research
05/28/2021

A Note on Optimal Fees for Constant Function Market Makers

We suggest a framework to determine optimal trading fees for constant fu...
research
02/19/2021

Rethinking the Funding Line at the Swiss National Science Foundation: Bayesian Ranking and Lottery

Funding agencies rely on peer review and expert panels to select the res...
research
06/11/2018

Simulation Study on a New Peer Review Approach

The increasing volume of scientific publications and grant proposals has...

Please sign up or login with your details

Forgot password? Click here to reset