Ergodicity of the underdamped mean-field Langevin dynamics

07/29/2020
by   Anna Kazeykina, et al.
0

We study the long time behavior of an underdamped mean-field Langevin (MFL) equation, and provide a general convergence as well as an exponential convergence rate result under different conditions. The results on the MFL equation can be applied to study the convergence of the Hamiltonian gradient descent algorithm for the overparametrized optimization. We then provide a numerical example of the algorithm to train a generative adversarial networks (GAN).

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/25/2022

Convex Analysis of the Mean Field Langevin Dynamics

As an example of the nonlinear Fokker-Planck equation, the mean field La...
research
03/14/2021

Mean Field Game GAN

We propose a novel mean field games (MFGs) based GAN(generative adversar...
research
05/06/2021

On Linear Damping Around Inhomogeneous Stationary States of the Vlasov-HMF Model

We study the dynamics of perturbations around an inhomogeneous stationar...
research
04/21/2023

Score-based Transport Modeling for Mean-Field Fokker-Planck Equations

We use the score-based transport modeling method to solve the mean-field...
research
04/06/2020

Game on Random Environement, Mean-field Langevin System and Neural Networks

In this paper we study a type of games regularized by the relative entro...
research
04/06/2020

Game on Random Environment, Mean-field Langevin System and Neural Networks

In this paper we study a type of games regularized by the relative entro...
research
09/25/2019

A Mean-Field Theory for Kernel Alignment with Random Features in Generative Adversarial Networks

We propose a novel supervised learning method to optimize the kernel in ...

Please sign up or login with your details

Forgot password? Click here to reset