Global exponential stability of primal-dual gradient flow dynamics based on the proximal augmented Lagrangian: A Lyapunov-based approach

10/02/2019
by   Dongsheng Ding, et al.
0

For a class of nonsmooth composite optimization problems with linear equality constraints, we utilize a Lyapunov-based approach to establish the global exponential stability of the primal-dual gradient flow dynamics based on the proximal augmented Lagrangian. The result holds when the differentiable part of the objective function is strongly convex with a Lipschitz continuous gradient; the non-differentiable part is proper, lower semi-continuous, and convex; and the matrix in the linear constraint is full row rank. Our quadratic Lyapunov function generalizes recent result from strongly convex problems with either affine equality or inequality constraints to a broader class of composite optimization problems with nonsmooth regularizers and it provides a worst-case lower bound of the exponential decay rate. Finally, we use computational experiments to demonstrate that our convergence rate estimate is less conservative than the existing alternatives.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/05/2017

A second order primal-dual method for nonsmooth convex composite optimization

We develop a second order primal-dual method for optimization problems i...
research
08/23/2019

Proximal gradient flow and Douglas-Rachford splitting dynamics: global exponential stability via integral quadratic constraints

Many large-scale and distributed optimization problems can be brought in...
research
03/27/2020

Distributed and time-varying primal-dual dynamics via contraction analysis

In this paper, we provide a holistic analysis of the primal-dual dynamic...
research
05/11/2020

Inexact and Stochastic Generalized Conditional Gradient with Augmented Lagrangian and Proximal Step

In this paper we propose and analyze inexact and stochastic versions of ...
research
05/22/2021

On anisotropic non-Lipschitz restoration model: lower bound theory and convergent algorithm

For nonconvex and nonsmooth restoration models, the lower bound theory r...
research
12/06/2022

BALPA: A Balanced Primal-Dual Algorithm for Nonsmooth Optimization with Application to Distributed Optimization

In this paper, we propose a novel primal-dual proximal splitting algorit...
research
10/25/2022

Faster Projection-Free Augmented Lagrangian Methods via Weak Proximal Oracle

This paper considers a convex composite optimization problem with affine...

Please sign up or login with your details

Forgot password? Click here to reset