Signatured Deep Fictitious Play for Mean Field Games with Common Noise

06/06/2021
by   Ming Min, et al.
0

Existing deep learning methods for solving mean-field games (MFGs) with common noise fix the sampling common noise paths and then solve the corresponding MFGs. This leads to a nested-loop structure with millions of simulations of common noise paths in order to produce accurate solutions, which results in prohibitive computational cost and limits the applications to a large extent. In this paper, based on the rough path theory, we propose a novel single-loop algorithm, named signatured deep fictitious play, by which we can work with the unfixed common noise setup to avoid the nested-loop structure and reduce the computational complexity significantly. The proposed algorithm can accurately capture the effect of common uncertainty changes on mean-field equilibria without further training of neural networks, as previously needed in the existing machine learning algorithms. The efficiency is supported by three applications, including linear-quadratic MFGs, mean-field portfolio game, and mean-field game of optimal consumption and investment. Overall, we provide a new point of view from the rough path theory to solve MFGs with common noise with significantly improved efficiency and an extensive range of applications. In addition, we report the first deep learning work to deal with extended MFGs (a mean-field interaction via both the states and controls) with common noise.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/02/2021

Exploration noise for learning linear-quadratic mean field games

The goal of this paper is to demonstrate that common noise may serve as ...
research
07/05/2020

Fictitious Play for Mean Field Games: Continuous Time Analysis and Applications

In this paper, we deepen the analysis of continuous time Fictitious Play...
research
07/09/2021

Deep Learning for Mean Field Games and Mean Field Control with Applications to Finance

Financial markets and more generally macro-economic models involve a lar...
research
02/25/2022

Random Features for High-Dimensional Nonlocal Mean-Field Games

We propose an efficient solution approach for high-dimensional nonlocal ...
research
11/16/2021

Learning Equilibria in Mean-Field Games: Introducing Mean-Field PSRO

Recent advances in multiagent learning have seen the introduction ofa fa...
research
04/06/2020

Game on Random Environement, Mean-field Langevin System and Neural Networks

In this paper we study a type of games regularized by the relative entro...
research
11/03/2019

Mean-field inference methods for neural networks

Machine learning algorithms relying on deep neural networks recently all...

Please sign up or login with your details

Forgot password? Click here to reset