Accelerated Distributed Aggregative Optimization

04/17/2023
by   Jiaxu Liu, et al.
0

In this paper, we investigate a distributed aggregative optimization problem in a network, where each agent has its own local cost function which depends not only on the local state variable but also on an aggregated function of state variables from all agents. To accelerate the optimization process, we combine heavy ball and Nesterov's accelerated methods with distributed aggregative gradient tracking, and propose two novel algorithms named DAGT-HB and DAGT-NES for solving the distributed aggregative optimization problem. We analyse that the DAGT-HB and DAGT-NES algorithms can converge to an optimal solution at a global 𝐑-linear convergence rate when the objective function is smooth and strongly convex, and when the parameters (e.g., step size and momentum coefficients) are selected within certain ranges. A numerical experiment on the optimal placement problem is given to verify the effectiveness and superiority of our proposed algorithms.

READ FULL TEXT
research
07/25/2022

Distributed Projection-free Algorithm for Constrained Aggregative Optimization

In this paper, we focus on solving a distributed convex aggregative opti...
research
03/21/2018

A Distributed Stochastic Gradient Tracking Method

In this paper, we study the problem of distributed multi-agent optimizat...
research
09/08/2020

Accelerated Multi-Agent Optimization Method over Stochastic Networks

We propose a distributed method to solve a multi-agent optimization prob...
research
11/11/2022

Fast model averaging via buffered states and first-order accelerated optimization algorithms

In this letter, we study the problem of accelerating reaching average co...
research
11/08/2020

Network Optimization via Smooth Exact Penalty Functions Enabled by Distributed Gradient Computation

This paper proposes a distributed algorithm for a network of agents to s...
research
10/14/2022

Distributed Computation for the Non-metric Data Placement Problem using Glauber Dynamics and Auctions

We consider the non-metric data placement problem and develop distribute...
research
03/08/2023

The Novel Adaptive Fractional Order Gradient Decent Algorithms Design via Robust Control

The vanilla fractional order gradient descent may oscillatively converge...

Please sign up or login with your details

Forgot password? Click here to reset