Distributed Nonconvex Constrained Optimization over Time-Varying Digraphs

09/04/2018
by   Gesualdo Scutari, et al.
0

This paper considers nonconvex distributed constrained optimization over networks, modeled as directed (possibly time-varying) graphs. We introduce the first algorithmic framework for the minimization of the sum of a smooth nonconvex (nonseparable) function--the agent's sum-utility--plus a Difference-of-Convex (DC) function (with nonsmooth convex part). This general formulation arises in many applications, from statistical machine learning to engineering. The proposed distributed method combines successive convex approximation techniques with a judiciously designed perturbed push-sum consensus mechanism that aims to track locally the gradient of the (smooth part of the) sum-utility. Sublinear convergence rate is proved when a fixed step-size (possibly different among the agents) is employed whereas asymptotic convergence to stationary solutions is proved using a diminishing step-size. Numerical results show that our algorithms compare favorably with current schemes on both convex and nonconvex problems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/07/2019

Convergence Rate of Distributed Optimization Algorithms Based on Gradient Tracking

We study distributed, strongly convex and nonconvex, multiagent optimiza...
research
04/30/2020

Distributed Stochastic Nonconvex Optimization and Learning based on Successive Convex Approximation

We study distributed stochastic nonconvex optimization in multi-agent ne...
research
03/28/2018

ASY-SONATA: Achieving Geometric Convergence for Distributed Asynchronous Optimization

Can one obtain a geometrically convergent algorithm for distributed asyn...
research
08/17/2018

Decentralized Dictionary Learning Over Time-Varying Digraphs

This paper studies Dictionary Learning problems wherein the learning tas...
research
11/24/2021

Finite-Time Error Bounds for Distributed Linear Stochastic Approximation

This paper considers a novel multi-agent linear stochastic approximation...
research
09/30/2014

Douglas-Rachford splitting for nonconvex optimization with application to nonconvex feasibility problems

We adapt the Douglas-Rachford (DR) splitting method to solve nonconvex f...
research
08/22/2018

Distributed Big-Data Optimization via Block-Iterative Gradient Tracking

We study distributed big-data nonconvex optimization in multi-agent netw...

Please sign up or login with your details

Forgot password? Click here to reset