Uniform-in-Time Propagation of Chaos for Mean Field Langevin Dynamics

12/06/2022
by   Fan Chen, et al.
0

We study the uniform-in-time propagation of chaos for mean field Langevin dynamics with convex mean field potenital. Convergences in both Wasserstein-2 distance and relative entropy are established. We do not require the mean field potenital functional to bear either small mean field interaction or displacement convexity, which are common constraints in the literature. In particular, it allows us to study the efficiency of the noisy gradient descent algorithm for training two-layer neural networks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/17/2022

Two-Scale Gradient Descent Ascent Dynamics Finds Mixed Nash Equilibria of Continuous Games: A Mean-Field Perspective

Finding the mixed Nash equilibria (MNE) of a two-player zero sum continu...
research
02/12/2023

Mean Field Optimization Problem Regularized by Fisher Information

Recently there is a rising interest in the research of mean field optimi...
research
04/06/2022

A Short Tutorial on Mean-Field Spin Glass Techniques for Non-Physicists

This tutorial is based on lecture notes written for a class taught in th...
research
10/21/2014

Mean-Field Networks

The mean field algorithm is a widely used approximate inference algorith...
research
07/09/2020

On the role of solute drag in reconciling laboratory and natural constraints on olivine grain growth kinetics

We investigate the effect of solute drag on grain growth (GG) kinetics i...
research
07/08/2019

Mean field models for large data-clustering problems

We consider mean-field models for data--clustering problems starting fro...
research
10/25/2022

Proximal Mean Field Learning in Shallow Neural Networks

Recent mean field interpretations of learning dynamics in over-parameter...

Please sign up or login with your details

Forgot password? Click here to reset