Strategic Instrumental Variable Regression: Recovering Causal Relationships From Strategic Responses

07/12/2021
by   Keegan Harris, et al.
0

Machine Learning algorithms often prompt individuals to strategically modify their observable attributes to receive more favorable predictions. As a result, the distribution the predictive model is trained on may differ from the one it operates on in deployment. While such distribution shifts, in general, hinder accurate predictions, our work identifies a unique opportunity associated with shifts due to strategic responses: We show that we can use strategic responses effectively to recover causal relationships between the observable features and outcomes we wish to predict. More specifically, we study a game-theoretic model in which a principal deploys a sequence of models to predict an outcome of interest (e.g., college GPA) for a sequence of strategic agents (e.g., college applicants). In response, strategic agents invest efforts and modify their features for better predictions. In such settings, unobserved confounding variables can influence both an agent's observable features (e.g., high school records) and outcomes. Therefore, standard regression methods generally produce biased estimators. In order to address this issue, our work establishes a novel connection between strategic responses to machine learning models and instrumental variable (IV) regression, by observing that the sequence of deployed models can be viewed as an instrument that affects agents' observable features but does not directly influence their outcomes. Therefore, two-stage least squares (2SLS) regression can recover the causal relationships between observable features and outcomes. Beyond causal recovery, we can build on our 2SLS method to address two additional relevant optimization objectives: agent outcome maximization and predictive risk minimization. Finally, our numerical simulations on semi-synthetic data show that our methods significantly outperform OLS regression in causal relationship estimation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/24/2020

Learning From Strategic Agents: Accuracy, Improvement, and Causality

In many predictive decision-making scenarios, such as credit scoring and...
research
02/13/2023

Causal Strategic Classification: A Tale of Two Shifts

When users can benefit from certain predictive outcomes, they may be pro...
research
02/17/2020

Causal Feature Discovery through Strategic Modification

We consider an online regression setting in which individuals adapt to t...
research
02/14/2023

Discovering Optimal Scoring Mechanisms in Causal Strategic Prediction

Faced with data-driven policies, individuals will manipulate their featu...
research
07/13/2018

How Do Classifiers Induce Agents To Invest Effort Strategically?

Machine learning is often used to produce decision-making rules that cla...
research
03/02/2021

Strategic Classification Made Practical

Strategic classification regards the problem of learning in settings whe...
research
02/09/2022

Generalized Strategic Classification and the Case of Aligned Incentives

Predicative machine learning models are frequently being used by compani...

Please sign up or login with your details

Forgot password? Click here to reset