DeepAI AI Chat
Log In Sign Up

Distributed and time-varying primal-dual dynamics via contraction analysis

03/27/2020
by   Pedro Cisneros-Velarde, et al.
The Regents of the University of California
0

In this paper, we provide a holistic analysis of the primal-dual dynamics associated to linear equality-constrained optimization problems and aimed at computing saddle-points of the associated Lagrangian using contraction analysis. We analyze the well-known standard version of the problem: we establish convergence results for convex objective functions and further characterize its convergence rate under strong convexity. Then, we consider a popular implementation of a distributed optimization problem and, using weaker notations of contraction theory, we establish the global exponential convergence of its associated distributed primal-dual dynamics. Moreover, based on this analysis, we propose a new distributed solver for the least-squares problem with global exponential convergence guarantees. Finally, we consider time-varying versions of the centralized and distributed implementations of primal-dual dynamics and exploit their contractive nature to establish asymptotic bounds on their tracking error. To support our convergence analyses, we introduce novel results on contraction theory and specifically use them in the cases where the analyzed systems are weakly contractive (i.e., has zero contraction rate) and/or converge to specific points belonging to a subspace of equilibria.

READ FULL TEXT

page 1

page 2

page 3

page 4

05/18/2021

A Contraction Theory Approach to Optimization Algorithms from Acceleration Flows

Much recent interest has focused on the design of optimization algorithm...
07/17/2019

Fast Distributed Coordination of Distributed Energy Resources Over Time-Varying Communication Networks

In this paper, we consider the problem of optimally coordinating the res...
06/13/2018

On Landscape of Lagrangian Functions and Stochastic Search for Constrained Nonconvex Optimization

We study constrained nonconvex optimization problems in machine learning...
10/30/2019

Duality and Stability in Complex Multiagent State-Dependent Network Dynamics

Many of the current challenges in science and engineering are related to...
04/24/2020

Primal and Dual Prediction-Correction Methods for Time-Varying Convex Optimization

We propose a unified framework for time-varying convex optimization base...
02/21/2022

Accelerating Primal-dual Methods for Regularized Markov Decision Processes

Entropy regularized Markov decision processes have been widely used in r...