Consensus-Based Optimization on the Sphere I: Well-Posedness and Mean-Field Limit

01/31/2020
by   Massimo Fornasier, et al.
0

We introduce a new stochastic Kuramoto-Vicsek-type model for global optimization of nonconvex functions on the sphere. This model belongs to the class of Consensus-Based Optimization methods. In fact, particles move on the sphere driven by a drift towards an instantaneous consensus point, computed as a convex combination of the particle locations weighted by the cost function according to Laplace's principle. The consensus point represents an approximation to a global minimizer. The dynamics is further perturbed by a random vector field to favor exploration, whose variance is a function of the distance of the particles to the consensus point. In particular, as soon as the consensus is reached, then the stochastic component vanishes. In this paper, we study the well-posedness of the model and we derive rigorously its mean-field approximation for large particle limit.

READ FULL TEXT

page 4

page 5

research
01/31/2020

Consensus-based Optimization on the Sphere II: Convergence to Global Minimizers and Machine Learning

We present the implementation of a new stochastic Kuramoto-Vicsek-type m...
research
12/10/2020

From particle swarm optimization to consensus based optimization: stochastic modeling and mean-field limit

In this paper we consider a continuous description based on stochastic d...
research
12/23/2022

Consensus-Based Optimization for Saddle Point Problems

In this paper, we propose consensus-based optimization for saddle point ...
research
11/09/2022

Polarized consensus-based dynamics for optimization and sampling

In this paper we propose polarized consensus-based dynamics in order to ...
research
06/15/2023

Kinetic based optimization enhanced by genetic dynamics

We propose and analyse a variant of the recently introduced kinetic base...
research
09/13/2019

Optimization on the Surface of the (Hyper)-Sphere

Thomson problem is a classical problem in physics to study how n number ...
research
03/28/2021

Consensus-based optimization methods converge globally in mean-field law

In this paper we study consensus-based optimization (CBO), which is a mu...

Please sign up or login with your details

Forgot password? Click here to reset