Deep Mean Field Games for Learning Optimal Behavior Policy of Large Populations

11/08/2017
by   Jiachen Yang, et al.
0

We consider the problem of representing a large population's behavior policy that drives the evolution of the population distribution over a discrete state space. A discrete time mean field game (MFG) is motivated as an interpretable model founded on game theory for understanding the aggregate effect of individual actions and predicting the temporal evolution of population distributions. We achieve a synthesis of MFG and Markov decision processes (MDP) by showing that a special MFG is reducible to an MDP. This enables us to broaden the scope of mean field game theory and infer MFG models of large real-world systems via deep inverse reinforcement learning. Our method learns both the reward function and forward dynamics of an MFG from real data, and we report the first empirical test of a mean field game model of a real-world social media population.

READ FULL TEXT
research
11/08/2017

Learning Deep Mean Field Games for Modeling Large Population Behavior

We consider the problem of representing collective behavior of large pop...
research
02/13/2022

Individual-Level Inverse Reinforcement Learning for Mean Field Games

The recent mean field game (MFG) formalism has enabled the application o...
research
01/16/2022

Master Equation for Discrete-Time Stackelberg Mean Field Games with single leader

In this paper, we consider a discrete-time Stackelberg mean field game w...
research
10/28/2019

Model-Free Mean-Field Reinforcement Learning: Mean-Field MDP and Mean-Field Q-Learning

We develop a general reinforcement learning framework for mean field con...
research
10/09/2019

Linear-Quadratic Mean-Field Reinforcement Learning: Convergence of Policy Gradient Methods

We investigate reinforcement learning for mean field control problems in...
research
09/20/2022

Deep Generalized Schrödinger Bridge

Mean-Field Game (MFG) serves as a crucial mathematical framework in mode...
research
09/07/2022

Master equation of discrete-time Stackelberg mean field games with multiple leaders

In this paper, we consider a discrete-time Stackelberg mean field game w...

Please sign up or login with your details

Forgot password? Click here to reset