A Divide-and-Conquer Algorithm for Distributed Optimization on Networks

12/03/2021
āˆ™
by   Nazar Emirov, et al.
āˆ™
0
āˆ™

In this paper, we consider networks with topologies described by some connected undirected graph š’¢=(V, E) and with some agents (fusion centers) equipped with processing power and local peer-to-peer communication, and optimization problem min_ x{F( x)=āˆ‘_iāˆˆ Vf_i( x)} with local objective functions f_i depending only on neighboring variables of the vertex iāˆˆ V. We introduce a divide-and-conquer algorithm to solve the above optimization problem in a distributed and decentralized manner. The proposed divide-and-conquer algorithm has exponential convergence, its computational cost is almost linear with respect to the size of the network, and it can be fully implemented at fusion centers of the network. Our numerical demonstrations also indicate that the proposed divide-and-conquer algorithm has superior performance than popular decentralized optimization methods do for the least squares problem with/without ā„“^1 penalty.

READ FULL TEXT
research
āˆ™ 07/26/2021

Provably Accelerated Decentralized Gradient Method Over Unbalanced Directed Graphs

In this work, we consider the decentralized optimization problem in whic...
research
āˆ™ 03/20/2018

A Push-Pull Gradient Method for Distributed Optimization in Networks

In this paper, we focus on solving a distributed convex optimization pro...
research
āˆ™ 03/25/2021

Compressed Gradient Tracking Methods for Decentralized Optimization with Linear Convergence

Communication compression techniques are of growing interests for solvin...
research
āˆ™ 10/14/2022

Communication-Efficient Topologies for Decentralized Learning with O(1) Consensus Rate

Decentralized optimization is an emerging paradigm in distributed learni...
research
āˆ™ 05/27/2021

Optimization in Open Networks via Dual Averaging

In networks of autonomous agents (e.g., fleets of vehicles, scattered se...
research
āˆ™ 10/17/2016

Decentralized Collaborative Learning of Personalized Models over Networks

We consider a set of learning agents in a collaborative peer-to-peer net...
research
āˆ™ 07/13/2019

Crisis: Probabilistically Self Organizing Total Order in Unstructured P2P Networks

A framework for asynchronous, signature free, fully local and probabilis...

Please sign up or login with your details

Forgot password? Click here to reset