Robust Multi-agent Counterfactual Prediction

04/03/2019
by   Alexander Peysakhovich, et al.
0

We consider the problem of using logged data to make predictions about what would happen if we changed the `rules of the game' in a multi-agent system. This task is difficult because in many cases we observe actions individuals take but not their private information or their full reward functions. In addition, agents are strategic, so when the rules change, they will also change their actions. Existing methods (e.g. structural estimation, inverse reinforcement learning) make counterfactual predictions by constructing a model of the game, adding the assumption that agents' behavior comes from optimizing given some goals, and then inverting observed actions to learn agent's underlying utility function (a.k.a. type). Once the agent types are known, making counterfactual predictions amounts to solving for the equilibrium of the counterfactual environment. This approach imposes heavy assumptions such as rationality of the agents being observed, correctness of the analyst's model of the environment/parametric form of the agents' utility functions, and various other conditions to make point identification possible. We propose a method for analyzing the sensitivity of counterfactual conclusions to violations of these assumptions. We refer to this method as robust multi-agent counterfactual prediction (RMAC). We apply our technique to investigating the robustness of counterfactual claims for classic environments in market design: auctions, school choice, and social choice. Importantly, we show RMAC can be used in regimes where point identification is impossible (e.g. those which have multiple equilibria or non-injective maps from type distributions to outcomes).

READ FULL TEXT
research
08/13/2019

Competitive Multi-Agent Deep Reinforcement Learning with Counterfactual Thinking

Counterfactual thinking describes a psychological phenomenon that people...
research
05/31/2019

Counterfactual Analysis under Partial Identification Using Locally Robust Refinement

Structural models that admit multiple reduced forms, such as game-theore...
research
12/07/2022

Counterfactuals for the Future

Counterfactuals are often described as 'retrospective,' focusing on hypo...
research
06/22/2022

PAC: Assisted Value Factorisation with Counterfactual Predictions in Multi-Agent Reinforcement Learning

Multi-agent reinforcement learning (MARL) has witnessed significant prog...
research
06/04/2022

Estimating counterfactual treatment outcomes over time in complex multi-agent scenarios

Evaluation of intervention in a multi-agent system, e.g., when humans sh...
research
04/27/2020

A Microscopic Epidemic Model and Pandemic Prediction Using Multi-Agent Reinforcement Learning

This paper introduces a microscopic approach to model epidemics, which c...
research
09/16/2022

Game-theoretic Objective Space Planning

Autonomous Racing awards agents that react to opponents' behaviors with ...

Please sign up or login with your details

Forgot password? Click here to reset