Gradient-Free Multi-Agent Nonconvex Nonsmooth Optimization

04/09/2019
by   Davood Hajinezhad, et al.
0

In this paper, we consider the problem of minimizing the sum of nonconvex and possibly nonsmooth functions over a connected multi-agent network, where the agents have partial knowledge about the global cost function and can only access the zeroth-order information (i.e., the functional values) of their local cost functions. We propose and analyze a distributed primal-dual gradient-free algorithm for this challenging problem. We show that by appropriately choosing the parameters, the proposed algorithm converges to the set of first order stationary solutions with a provable global sublinear convergence rate. Numerical experiments demonstrate the effectiveness of our proposed method for optimizing nonconvex and nonsmooth problems over a network.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/27/2017

Zeroth Order Nonconvex Multi-Agent Optimization over Networks

In this paper we consider distributed optimization problems over a multi...
research
03/24/2021

Convergence Analysis of Nonconvex Distributed Stochastic Zeroth-order Coordinate Method

This paper investigates the stochastic distributed nonconvex optimizatio...
research
03/23/2018

Asynchronous Subgradient-Push

We consider a multi-agent framework for distributed optimization where e...
research
02/01/2022

Gradient Based Clustering

We propose a general approach for distance based clustering, using the g...
research
11/19/2020

Zeroth-Order Feedback Optimization for Cooperative Multi-Agent Systems

We study a class of cooperative multi-agent optimization problems, where...
research
03/08/2022

Mini-batch stochastic three-operator splitting for distributed optimization

We consider a network of agents, each with its own private cost consisti...
research
08/08/2023

Minimizing Quotient Regularization Model

Quotient regularization models (QRMs) are a class of powerful regulariza...

Please sign up or login with your details

Forgot password? Click here to reset