Accelerated Symmetric ADMM and Its Applications in Signal Processing

06/28/2019
by   Jianchao Bai, et al.
0

The alternating direction method of multipliers (ADMM) were extensively investigated in the past decades for solving separable convex optimization problems. Fewer researchers focused on exploring its convergence properties for the nonconvex case although it performed surprisingly efficient. In this paper, we propose a symmetric ADMM based on different acceleration techniques for a family of potentially nonsmooth nonconvex programing problems with equality constraints, where the dual variables are updated twice with different stepsizes. Under proper assumptions instead of using the so-called Kurdyka-Lojasiewicz inequality, convergence of the proposed algorithm as well as its pointwise iteration-complexity are analyzed in terms of the corresponding augmented Lagrangian function and the primal-dual residuals, respectively. Performance of our algorithm is verified by some preliminary numerical examples on applications in sparse nonconvex/convex regularized minimization signal processing problems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/30/2021

Convergence on a symmetric accelerated stochastic ADMM with larger stepsizes

In this paper, we develop a symmetric accelerated stochastic Alternating...
research
12/13/2017

Penalty Dual Decomposition Method For Nonsmooth Nonconvex Optimization

Many contemporary signal processing, machine learning and wireless commu...
research
06/25/2020

Anderson Acceleration for Nonconvex ADMM Based on Douglas-Rachford Splitting

The alternating direction multiplier method (ADMM) is widely used in com...
research
01/19/2022

Multiblock ADMM for nonsmooth nonconvex optimization with nonlinear coupling constraints

This paper considers a multiblock nonsmooth nonconvex optimization probl...
research
05/04/2022

Proximal ADMM for Nonconvex and Nonsmooth Optimization

By enabling the nodes or agents to solve small-sized subproblems to achi...
research
11/13/2017

A Parallel Best-Response Algorithm with Exact Line Search for Nonconvex Sparsity-Regularized Rank Minimization

In this paper, we propose a convergent parallel best-response algorithm ...
research
07/07/2019

Fast and Provable ADMM for Learning with Generative Priors

In this work, we propose a (linearized) Alternating Direction Method-of-...

Please sign up or login with your details

Forgot password? Click here to reset