Consensus-Based Optimization for Saddle Point Problems

12/23/2022
by   Hui Huang, et al.
0

In this paper, we propose consensus-based optimization for saddle point problems (CBO-SP), a novel multi-particle metaheuristic derivative-free optimization method capable of provably finding global Nash equilibria. Following the idea of swarm intelligence, the method employs a group of interacting particles, which perform a minimization over one variable and a maximization over the other. This paradigm permits a passage to the mean-field limit, which makes the method amenable to theoretical analysis and allows to obtain rigorous convergence guarantees under reasonable assumptions about the initialization and the objective function, which most notably include nonconvex-nonconcave objectives.

READ FULL TEXT
research
11/15/2021

Convergence of Anisotropic Consensus-Based Optimization in Mean-Field Law

In this paper we study anisotropic consensus-based optimization (CBO), a...
research
01/31/2020

Consensus-Based Optimization on the Sphere I: Well-Posedness and Mean-Field Limit

We introduce a new stochastic Kuramoto-Vicsek-type model for global opti...
research
05/04/2023

FedCBO: Reaching Group Consensus in Clustered Federated Learning through Consensus-based Optimization

Federated learning is an important framework in modern machine learning ...
research
08/01/2021

Mean-field particle swarm optimization

In this work we survey some recent results on the global minimization of...
research
04/14/2021

Zero-Inertia Limit: from Particle Swarm Optimization to Consensus Based Optimization

Recently a continuous description of the particle swarm optimization (PS...
research
03/28/2021

Consensus-based optimization methods converge globally in mean-field law

In this paper we study consensus-based optimization (CBO), which is a mu...
research
01/31/2020

Consensus-based Optimization on the Sphere II: Convergence to Global Minimizers and Machine Learning

We present the implementation of a new stochastic Kuramoto-Vicsek-type m...

Please sign up or login with your details

Forgot password? Click here to reset