Distributed Mirror Descent with Integral Feedback: Asymptotic Convergence Analysis of Continuous-time Dynamics

09/14/2020
by   Youbang Sun, et al.
0

This work addresses distributed optimization, where a network of agents wants to minimize a global strongly convex objective function. The global function can be written as a sum of local convex functions, each of which is associated with an agent. We propose a continuous-time distributed mirror descent algorithm that uses purely local information to converge to the global optimum. Unlike previous work on distributed mirror descent, we incorporate an integral feedback in the update, allowing the algorithm to converge with a constant step-size when discretized. We establish the asymptotic convergence of the algorithm using Lyapunov stability analysis. We further illustrate numerical experiments that verify the advantage of adopting integral feedback for improving the convergence rate of distributed mirror descent.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/24/2020

Linear Convergence of Distributed Mirror Descent with Integral Feedback for Strongly Convex Problems

Distributed optimization often requires finding the minimum of a global ...
research
03/23/2018

Asynchronous Subgradient-Push

We consider a multi-agent framework for distributed optimization where e...
research
09/09/2016

Distributed Online Optimization in Dynamic Environments Using Mirror Descent

This work addresses decentralized online optimization in non-stationary ...
research
06/19/2020

Meta Learning in the Continuous Time Limit

In this paper, we establish the ordinary differential equation (ODE) tha...
research
08/06/2019

On Convergence of Distributed Approximate Newton Methods: Globalization, Sharper Bounds and Beyond

The DANE algorithm is an approximate Newton method popularly used for co...
research
02/25/2020

Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis

We study distributed composite optimization over networks: agents minimi...
research
03/19/2017

A Passivity-Based Distributed Reference Governor for Constrained Robotic Networks

This paper focuses on a passivity-based distributed reference governor (...

Please sign up or login with your details

Forgot password? Click here to reset