Performative Prediction

02/16/2020
by   Juan C. Perdomo, et al.
0

When predictions support decisions they may influence the outcome they aim to predict. We call such predictions performative; the prediction influences the target. Performativity is a well-studied phenomenon in policy-making that has so far been neglected in supervised learning. When ignored, performativity surfaces as undesirable distribution shift, routinely addressed with retraining. We develop a risk minimization framework for performative prediction bringing together concepts from statistics, game theory, and causality. A conceptual novelty is an equilibrium notion we call performative stability. Performative stability implies that the predictions are calibrated not against past outcomes, but against the future outcomes that manifest from acting on the prediction. Our main results are necessary and sufficient conditions for the convergence of retraining to a performatively stable point of nearly minimal loss. In full generality, performative prediction strictly subsumes the setting known as strategic classification. We thus also give the first sufficient conditions for retraining to overcome strategic feedback effects.

READ FULL TEXT
research
10/04/2022

Making Decisions under Outcome Performativity

Decision-makers often act in response to data-driven predictions, with t...
research
01/25/2022

Multi-agent Performative Prediction: From Global Stability and Optimality to Chaos

The recent framework of performative prediction is aimed at capturing se...
research
10/30/2018

Evolutionarily Stable Preferences Against Multiple Mutations

We use the indirect evolutionary approach to study evolutionarily stable...
research
09/02/2021

Multi-agent Bayesian Learning with Best Response Dynamics: Convergence and Stability

We study learning dynamics induced by strategic agents who repeatedly pl...
research
05/30/2023

Plug-in Performative Optimization

When predictions are performative, the choice of which predictor to depl...
research
11/08/2020

Performative Prediction in a Stateful World

Deployed supervised machine learning models make predictions that intera...
research
06/12/2022

Convergence and Stability of Coupled Belief–Strategy Learning Dynamics in Continuous Games

We propose a learning dynamics to model how strategic agents repeatedly ...

Please sign up or login with your details

Forgot password? Click here to reset