DeepAI AI Chat
Log In Sign Up

Uniform-in-Time Propagation of Chaos for Mean Field Langevin Dynamics

by   Fan Chen, et al.

We study the uniform-in-time propagation of chaos for mean field Langevin dynamics with convex mean field potenital. Convergences in both Wasserstein-2 distance and relative entropy are established. We do not require the mean field potenital functional to bear either small mean field interaction or displacement convexity, which are common constraints in the literature. In particular, it allows us to study the efficiency of the noisy gradient descent algorithm for training two-layer neural networks.


page 1

page 2

page 3

page 4


Two-Scale Gradient Descent Ascent Dynamics Finds Mixed Nash Equilibria of Continuous Games: A Mean-Field Perspective

Finding the mixed Nash equilibria (MNE) of a two-player zero sum continu...

Mean Field Optimization Problem Regularized by Fisher Information

Recently there is a rising interest in the research of mean field optimi...

A Short Tutorial on Mean-Field Spin Glass Techniques for Non-Physicists

This tutorial is based on lecture notes written for a class taught in th...

Mean-Field Networks

The mean field algorithm is a widely used approximate inference algorith...

On the role of solute drag in reconciling laboratory and natural constraints on olivine grain growth kinetics

We investigate the effect of solute drag on grain growth (GG) kinetics i...

Mean field models for large data-clustering problems

We consider mean-field models for data--clustering problems starting fro...

Proximal Mean Field Learning in Shallow Neural Networks

Recent mean field interpretations of learning dynamics in over-parameter...