Making Decisions under Outcome Performativity

10/04/2022
by   Michael P. Kim, et al.
0

Decision-makers often act in response to data-driven predictions, with the goal of achieving favorable outcomes. In such settings, predictions don't passively forecast the future; instead, predictions actively shape the distribution of outcomes they are meant to predict. This performative prediction setting raises new challenges for learning "optimal" decision rules. In particular, existing solution concepts do not address the apparent tension between the goals of forecasting outcomes accurately and steering individuals to achieve desirable outcomes. To contend with this concern, we introduce a new optimality concept – performative omniprediction – adapted from the supervised (non-performative) learning setting. A performative omnipredictor is a single predictor that simultaneously encodes the optimal decision rule with respect to many possibly-competing objectives. Our main result demonstrates that efficient performative omnipredictors exist, under a natural restriction of performative prediction, which we call outcome performativity. On a technical level, our results follow by carefully generalizing the notion of outcome indistinguishability to the outcome performative setting. From an appropriate notion of Performative OI, we recover many consequences known to hold in the supervised setting, such as omniprediction and universal adaptability.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/16/2020

Performative Prediction

When predictions support decisions they may influence the outcome they a...
research
10/04/2019

The Disparate Equilibria of Algorithmic Decision Making when Individuals Invest Rationally

The long-term impact of algorithmic decision making is shaped by the dyn...
research
05/28/2023

Incentivizing honest performative predictions with proper scoring rules

Proper scoring rules incentivize experts to accurately report beliefs, a...
research
03/01/2020

When the Oracle Misleads: Modeling the Consequences of Using Observable Rather than Potential Outcomes in Risk Assessment Instruments

Machine learning-based Risk Assessment Instruments are increasingly wide...
research
08/17/2022

On the Role of Negative Precedent in Legal Outcome Prediction

Every legal case sets a precedent by developing the law in one of the fo...
research
07/20/2021

Evaluating Probabilistic Inference in Deep Learning: Beyond Marginal Predictions

A fundamental challenge for any intelligent system is prediction: given ...
research
01/30/2018

Surprise in Elections

Elections involving a very large voter population often lead to outcomes...

Please sign up or login with your details

Forgot password? Click here to reset