DeepAI AI Chat
Log In Sign Up

Scoring Rules for Performative Binary Prediction

07/05/2022
by   Alan Chan, et al.
Montréal Institute of Learning Algorithms
0

We construct a model of expert prediction where predictions can influence the state of the world. Under this model, we show through theoretical and numerical results that proper scoring rules can incentivize experts to manipulate the world with their predictions. We also construct a simple class of scoring rules that avoids this problem.

READ FULL TEXT

page 1

page 2

page 3

page 4

07/06/2020

Optimization of Scoring Rules

This paper introduces an objective for optimizing proper scoring rules. ...
08/22/2018

Calibration Scoring Rules for Practical Prediction Training

In situations where forecasters are scored on the quality of their proba...
06/13/2011

Eliciting Forecasts from Self-interested Experts: Scoring Rules for Decision Makers

Scoring rules for eliciting expert predictions of random variables are u...
12/10/2022

Scoring rules in survival analysis

Scoring rules promote rational and good decision making and predictions ...
05/13/2018

Strategy-Proof Incentives for Predictions

Our aim is to design mechanisms that motivate all agents to reveal their...
01/27/2023

From Classification Accuracy to Proper Scoring Rules: Elicitability of Probabilistic Top List Predictions

In the face of uncertainty, the need for probabilistic assessments has l...
01/07/2014

Cortical prediction markets

We investigate cortical learning from the perspective of mechanism desig...