DeepAI AI Chat
Log In Sign Up

Uniform-in-Time Propagation of Chaos for Mean Field Langevin Dynamics

12/06/2022
by   Fan Chen, et al.
0

We study the uniform-in-time propagation of chaos for mean field Langevin dynamics with convex mean field potenital. Convergences in both Wasserstein-2 distance and relative entropy are established. We do not require the mean field potenital functional to bear either small mean field interaction or displacement convexity, which are common constraints in the literature. In particular, it allows us to study the efficiency of the noisy gradient descent algorithm for training two-layer neural networks.

READ FULL TEXT

page 1

page 2

page 3

page 4

12/17/2022

Two-Scale Gradient Descent Ascent Dynamics Finds Mixed Nash Equilibria of Continuous Games: A Mean-Field Perspective

Finding the mixed Nash equilibria (MNE) of a two-player zero sum continu...
02/12/2023

Mean Field Optimization Problem Regularized by Fisher Information

Recently there is a rising interest in the research of mean field optimi...
04/06/2022

A Short Tutorial on Mean-Field Spin Glass Techniques for Non-Physicists

This tutorial is based on lecture notes written for a class taught in th...
10/21/2014

Mean-Field Networks

The mean field algorithm is a widely used approximate inference algorith...
07/09/2020

On the role of solute drag in reconciling laboratory and natural constraints on olivine grain growth kinetics

We investigate the effect of solute drag on grain growth (GG) kinetics i...
07/08/2019

Mean field models for large data-clustering problems

We consider mean-field models for data--clustering problems starting fro...
10/25/2022

Proximal Mean Field Learning in Shallow Neural Networks

Recent mean field interpretations of learning dynamics in over-parameter...