Alignment Problems With Current Forecasting Platforms

06/21/2021
by   Nuño Sempere, et al.
0

We present alignment problems in current forecasting platforms, such as Good Judgment Open, CSET-Foretell or Metaculus. We classify those problems as either reward specification problems or principal-agent problems, and we propose solutions. For instance, the scoring rule used by Good Judgment Open is not proper, and Metaculus tournaments disincentivize sharing information and incentivize distorting one's true probabilities to maximize the chances of placing in the top few positions which earn a monetary reward. We also point out some partial similarities between the problem of aligning forecasters and the problem of aligning artificial intelligence systems.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 14

page 15

page 35

08/19/2019

Implications of Quantum Computing for Artificial Intelligence alignment research

We introduce a heuristic model of Quantum Computing and apply it to argu...
02/07/2021

Consequences of Misaligned AI

AI systems often rely on two key components: a specified goal or reward ...
05/27/2019

Open Platforms for Artificial Intelligence for Social Good: Common Patterns as a Pathway to True Impact

The AI for social good movement has now reached a state in which a large...
07/15/2021

Optimal Scoring Rule Design

This paper introduces an optimization problem for proper scoring rule de...
04/26/2021

Heterogeneous-Agent Trajectory Forecasting Incorporating Class Uncertainty

Reasoning about the future behavior of other agents is critical to safe ...
08/29/2020

Wisdom of the crowds forecasting the 2018 FIFA Men's World Cup

The FIFA Men's World Cup Tournament (WCT) is the most important football...
02/08/2019

Taxonomy driven indicator scoring in MISP threat intelligence platforms

IT security community is recently facing a change of trend from closed t...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.