From particle swarm optimization to consensus based optimization: stochastic modeling and mean-field limit

12/10/2020
by   Sara Grassi, et al.
0

In this paper we consider a continuous description based on stochastic differential equations of the popular particle swarm optimization (PSO) process for solving global optimization problems and derive in the large particle limit the corresponding mean-field approximation based on Vlasov-Fokker-Planck-type equations. The disadvantage of memory effects induced by the need to store the local best position is overcome by the introduction of an additional differential equation describing the evolution of the local best. A regularization process for the global best permits to formally derive the respective mean-field description. Subsequently, in the small inertia limit, we compute the related macroscopic hydrodynamic equations that clarify the link with the recently introduced consensus based optimization (CBO) methods. Several numerical examples illustrate the mean field process, the small inertia limit and the potential of this general class of global optimization methods.

READ FULL TEXT

page 15

page 16

page 17

page 18

page 19

page 20

research
08/01/2021

Mean-field particle swarm optimization

In this work we survey some recent results on the global minimization of...
research
04/14/2021

Zero-Inertia Limit: from Particle Swarm Optimization to Consensus Based Optimization

Recently a continuous description of the particle swarm optimization (PS...
research
05/10/2022

Consensus based optimization via jump-diffusion stochastic differential equations

We introduce a new consensus based optimization (CBO) method where inter...
research
06/15/2023

Kinetic based optimization enhanced by genetic dynamics

We propose and analyse a variant of the recently introduced kinetic base...
research
01/31/2020

Consensus-Based Optimization on the Sphere I: Well-Posedness and Mean-Field Limit

We introduce a new stochastic Kuramoto-Vicsek-type model for global opti...
research
01/29/2022

On the Global Convergence of Particle Swarm Optimization Methods

In this paper we provide a rigorous convergence analysis for the renowne...
research
11/08/2019

Coupled Systems of Differential-Algebraic and Kinetic Equations with Application to the Mathematical Modelling of Muscle Tissue

We consider a coupled system composed of a differential-algebraic equati...

Please sign up or login with your details

Forgot password? Click here to reset