Distributed and time-varying primal-dual dynamics via contraction analysis

03/27/2020
by   Pedro Cisneros-Velarde, et al.
0

In this paper, we provide a holistic analysis of the primal-dual dynamics associated to linear equality-constrained optimization problems and aimed at computing saddle-points of the associated Lagrangian using contraction analysis. We analyze the well-known standard version of the problem: we establish convergence results for convex objective functions and further characterize its convergence rate under strong convexity. Then, we consider a popular implementation of a distributed optimization problem and, using weaker notations of contraction theory, we establish the global exponential convergence of its associated distributed primal-dual dynamics. Moreover, based on this analysis, we propose a new distributed solver for the least-squares problem with global exponential convergence guarantees. Finally, we consider time-varying versions of the centralized and distributed implementations of primal-dual dynamics and exploit their contractive nature to establish asymptotic bounds on their tracking error. To support our convergence analyses, we introduce novel results on contraction theory and specifically use them in the cases where the analyzed systems are weakly contractive (i.e., has zero contraction rate) and/or converge to specific points belonging to a subspace of equilibria.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/18/2021

A Contraction Theory Approach to Optimization Algorithms from Acceleration Flows

Much recent interest has focused on the design of optimization algorithm...
research
10/02/2019

Global exponential stability of primal-dual gradient flow dynamics based on the proximal augmented Lagrangian: A Lyapunov-based approach

For a class of nonsmooth composite optimization problems with linear equ...
research
07/17/2019

Fast Distributed Coordination of Distributed Energy Resources Over Time-Varying Communication Networks

In this paper, we consider the problem of optimally coordinating the res...
research
06/13/2018

On Landscape of Lagrangian Functions and Stochastic Search for Constrained Nonconvex Optimization

We study constrained nonconvex optimization problems in machine learning...
research
12/06/2022

BALPA: A Balanced Primal-Dual Algorithm for Nonsmooth Optimization with Application to Distributed Optimization

In this paper, we propose a novel primal-dual proximal splitting algorit...
research
10/30/2019

Duality and Stability in Complex Multiagent State-Dependent Network Dynamics

Many of the current challenges in science and engineering are related to...
research
04/24/2020

Primal and Dual Prediction-Correction Methods for Time-Varying Convex Optimization

We propose a unified framework for time-varying convex optimization base...

Please sign up or login with your details

Forgot password? Click here to reset