Bridging Mean-Field Games and Normalizing Flows with Trajectory Regularization

06/30/2022
by   Han Huang, et al.
22

Mean-field games (MFGs) are a modeling framework for systems with a large number of interacting agents. They have applications in economics, finance, and game theory. Normalizing flows (NFs) are a family of deep generative models that compute data likelihoods by using an invertible mapping, which is typically parameterized by using neural networks. They are useful for density modeling and data generation. While active research has been conducted on both models, few noted the relationship between the two. In this work, we unravel the connections between MFGs and NFs by contextualizing the training of an NF as solving the MFG. This is achieved by reformulating the MFG problem in terms of agent trajectories and parameterizing a discretization of the resulting MFG with flow architectures. With this connection, we explore two research directions. First, we employ expressive NF architectures to accurately solve high-dimensional MFGs, sidestepping the curse of dimensionality in traditional numerical methods. Compared with other deep learning approaches, our trajectory-based formulation encodes the continuity equation in the neural network, resulting in a better approximation of the population dynamics. Second, we regularize the training of NFs with transport costs and show the effectiveness on controlling the model's Lipschitz bound, resulting in better generalization performance. We demonstrate numerical results through comprehensive experiments on a variety of synthetic and real-life datasets.

READ FULL TEXT

page 11

page 14

page 28

page 29

page 30

page 31

page 33

page 34

02/15/2020

A Machine Learning Framework for Solving High-Dimensional Mean Field Game and Mean Field Control Problems

Mean field games (MFG) and mean field control (MFC) are critical classes...
03/30/2022

Hypergraphon Mean Field Games

We propose an approach to modelling large-scale multi-agent dynamical sy...
02/25/2022

Random Features for High-Dimensional Nonlocal Mean-Field Games

We propose an efficient solution approach for high-dimensional nonlocal ...
07/09/2021

Deep Learning for Mean Field Games and Mean Field Control with Applications to Finance

Financial markets and more generally macro-economic models involve a lar...
03/14/2021

Mean Field Game GAN

We propose a novel mean field games (MFGs) based GAN(generative adversar...
05/25/2022

Learning Mean Field Games: A Survey

Non-cooperative and cooperative games with a very large number of player...
03/10/2021

Mean-field methods and algorithmic perspectives for high-dimensional machine learning

The main difficulty that arises in the analysis of most machine learning...