PeerNomination: Relaxing Exactness for Increased Accuracy in Peer Selection

04/30/2020
by   Nicholas Mattei, et al.
0

In peer selection agents must choose a subset of themselves for an award or a prize. As agents are self-interested, we want to design algorithms that are impartial, so that an individual agent cannot affect their own chance of being selected. This problem has broad application in resource allocation and mechanism design and has received substantial attention in the artificial intelligence literature. Here, we present a novel algorithm for impartial peer selection, PeerNomination, and provide a theoretical analysis of its accuracy. Our algorithm possesses various desirable features. In particular, it does not require an explicit partitioning of the agents, as previous algorithms in the literature. We show empirically that it achieves higher accuracy than the exiting algorithms over several metrics.

READ FULL TEXT
research
07/21/2021

Peer Selection with Noisy Assessments

In the peer selection problem a group of agents must select a subset of ...
research
04/13/2016

Strategyproof Peer Selection using Randomization, Partitioning, and Apportionment

Peer review, evaluation, and selection is a fundamental aspect of modern...
research
11/12/2019

Fast Stochastic Peer Selection in Proof-of-Stake Protocols

The problem of peer selection, which randomly selects a peer from a set,...
research
04/16/2019

Rethinking Resource Allocation in Science

US funding agencies alone distribute a yearly total of roughly 65B dolla...
research
10/25/2009

Sum of Us: Strategyproof Selection from the Selectors

We consider directed graphs over a set of n agents, where an edge (i,j) ...
research
01/18/2021

Detection of Insider Attacks in Distributed Projected Subgradient Algorithms

The gossip-based distributed algorithms are widely used to solve decentr...
research
05/28/2014

The PeerRank Method for Peer Assessment

We propose the PeerRank method for peer assessment. This constructs a gr...

Please sign up or login with your details

Forgot password? Click here to reset