DeepAI AI Chat
Log In Sign Up

Separable Approximations and Decomposition Methods for the Augmented Lagrangian

by   Rachael Tappenden, et al.

In this paper we study decomposition methods based on separable approximations for minimizing the augmented Lagrangian. In particular, we study and compare the Diagonal Quadratic Approximation Method (DQAM) of Mulvey and Ruszczyński and the Parallel Coordinate Descent Method (PCDM) of Richtárik and Takáč. We show that the two methods are equivalent for feasibility problems up to the selection of a single step-size parameter. Furthermore, we prove an improved complexity bound for PCDM under strong convexity, and show that this bound is at least 8(L'/L̅)(ω-1)^2 times better than the best known bound for DQAM, where ω is the degree of partial separability and L' and L̅ are the maximum and average of the block Lipschitz constants of the gradient of the quadratic penalty appearing in the augmented Lagrangian.


page 1

page 2

page 3

page 4


Augmented Lagrangian Method for Thin Plates with Signorini Boundaries

We consider C^1-continuous approximations of the Kirchhoff plate problem...

Penalty Augmented Kaczmarz Methods For Linear Systems Linear Feasibility Problems

In this work, we shed light on the so-called Kaczmarz method for solving...

ALS: Augmented Lagrangian Sketching Methods for Linear Systems

We develop two fundamental stochastic sketching techniques; Penalty Sket...

A first-order augmented Lagrangian method for constrained minimax optimization

In this paper we study a class of constrained minimax problems. In parti...

Discrete Variational Methods and Symplectic Generalized Additive Runge–Kutta Methods

We consider a Lagrangian system L(q,q̇) = ∑_l=1^NL^{l}(q,q̇), where th...

Augmented RBMLE-UCB Approach for Adaptive Control of Linear Quadratic Systems

We consider the problem of controlling a stochastic linear system with q...

Restricted Linearized Augmented Lagrangian Method for Euler's Elastica Model

Euler's elastica model has been extensively studied and applied to image...