Consensus based optimization via jump-diffusion stochastic differential equations

05/10/2022
by   D. Kalise, et al.
0

We introduce a new consensus based optimization (CBO) method where interacting particle system is driven by jump-diffusion stochastic differential equations. We study well-posedness of the particle system as well as of its mean-field limit. The major contributions of this paper are proofs of convergence of the interacting particle system towards the mean-field limit and convergence of a discretized particle system towards the continuous-time dynamics in the mean-square sense. We also prove convergence of the mean-field jump-diffusion SDEs towards global minimizer for a large class of objective functions. We demonstrate improved performance of the proposed CBO method over earlier CBO methods in numerical simulations on benchmark objective functions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/10/2020

From particle swarm optimization to consensus based optimization: stochastic modeling and mean-field limit

In this paper we consider a continuous description based on stochastic d...
research
11/09/2022

Polarized consensus-based dynamics for optimization and sampling

In this paper we propose polarized consensus-based dynamics in order to ...
research
05/04/2023

FedCBO: Reaching Group Consensus in Clustered Federated Learning through Consensus-based Optimization

Federated learning is an important framework in modern machine learning ...
research
01/14/2020

Numerical methods for mean-field stochastic differential equations with jumps

In this paper, we are devoted to the numerical methods for mean-field st...
research
01/29/2022

On the Global Convergence of Particle Swarm Optimization Methods

In this paper we provide a rigorous convergence analysis for the renowne...
research
06/01/2020

Interacting particle solutions of Fokker-Planck equations through gradient-log-density estimation

Fokker-Planck equations are extensively employed in various scientific f...
research
02/25/2022

A blob method for inhomogeneous diffusion with applications to multi-agent control and sampling

As a counterpoint to classical stochastic particle methods for linear di...

Please sign up or login with your details

Forgot password? Click here to reset