Agreement Implies Accuracy for Substitutable Signals

11/05/2021
by   Rafael Frongillo, et al.
0

Inspired by Aumann's agreement theorem, Scott Aaronson studied the amount of communication necessary for two Bayesian experts to approximately agree on the expectation of a random variable. Aaronson showed that, remarkably, the number of bits does not depend on the amount of information available to each expert. However, in general the agreed-upon estimate may be inaccurate: far from the estimate they would settle on if they were to share all of their information. We show that if the experts' signals are substitutes – meaning the experts' information has diminishing marginal returns – then it is the case that if the experts are close to agreement then they are close to the truth. We prove this result for a broad class of agreement and accuracy measures that includes squared distance and KL divergence. Additionally, we show that although these measures capture fundamentally different kinds of agreement, Aaronson's agreement result generalizes to them as well.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/26/2020

Computing Information Agreement

Agreement measures are useful to both compare different evaluations of t...
research
01/21/2020

Explicit agreement extremes for a 2×2 table with given marginals

The problem of maximizing (or minimizing) the agreement between clusteri...
research
11/01/2018

Unique Information and Secret Key Agreement

The partial information decomposition (PID) is a promising framework for...
research
11/04/2021

Are You Smarter Than a Random Expert? The Robust Aggregation of Substitutable Signals

The problem of aggregating expert forecasts is ubiquitous in fields as w...
research
03/14/2023

Information-Theoretic Regret Bounds for Bandits with Fixed Expert Advice

We investigate the problem of bandits with expert advice when the expert...
research
05/16/2023

Diversity, Agreement, and Polarization in Elections

We consider the notions of agreement, diversity, and polarization in ord...
research
09/08/2021

AgreementLearning: An End-to-End Framework for Learning with Multiple Annotators without Groundtruth

The annotation of domain experts is important for some medical applicati...

Please sign up or login with your details

Forgot password? Click here to reset