Exploration noise for learning linear-quadratic mean field games

07/02/2021
by   François Delarue, et al.
0

The goal of this paper is to demonstrate that common noise may serve as an exploration noise for learning the solution of a mean field game. This concept is here exemplified through a toy linear-quadratic model, for which a suitable form of common noise has already been proven to restore existence and uniqueness. We here go one step further and prove that the same form of common noise may force the convergence of the learning algorithm called `fictitious play', and this without any further potential or monotone structure. Several numerical examples are provided in order to support our theoretical analysis.

READ FULL TEXT

page 7

page 8

page 10

research
07/05/2020

Fictitious Play for Mean Field Games: Continuous Time Analysis and Applications

In this paper, we deepen the analysis of continuous time Fictitious Play...
research
06/06/2021

Signatured Deep Fictitious Play for Mean Field Games with Common Noise

Existing deep learning methods for solving mean-field games (MFGs) with ...
research
03/24/2020

Q-Learning in Regularized Mean-field Games

In this paper, we introduce a regularized mean-field game and study lear...
research
07/09/2020

A Simple Multiscale Method for Mean Field Games

This paper proposes a multiscale method for solving the numerical soluti...
research
07/30/2020

Characterizing digital microstructures by the Minkowski-based quadratic normal tensor

For material modeling of microstructured media, an accurate characteriza...
research
04/23/2019

Matrix-Valued Mean-Field-Type Games: Risk-Sensitive, Adversarial, and Risk-Neutral Linear-Quadratic Case

In this paper we study a class of matrix-valued linear-quadratic mean-fi...
research
06/20/2022

MF-OMO: An Optimization Formulation of Mean-Field Games

Theory of mean-field games (MFGs) has recently experienced an exponentia...

Please sign up or login with your details

Forgot password? Click here to reset