Multiblock ADMM for nonsmooth nonconvex optimization with nonlinear coupling constraints

01/19/2022
by   Le Thi Khanh Hien, et al.
0

This paper considers a multiblock nonsmooth nonconvex optimization problem with nonlinear coupling constraints. By developing the idea of using the information zone and adaptive regime proposed in [J. Bolte, S. Sabach and M. Teboulle, Nonconvex Lagrangian-based optimization: Monitoring schemes and global convergence, Mathematics of Operations Research, 43: 1210–1232, 2018], we propose a multiblock alternating direction method of multipliers for solving this problem. We specify the update of the primal variables by employing a majorization minimization procedure in each block update. An independent convergence analysis is conducted to prove subsequential as well as global convergence of the generated sequence to a critical point of the augmented Lagrangian. We also establish iteration complexity and provide preliminary numerical results for the proposed algorithm.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/10/2021

A Framework of Inertial Alternating Direction Method of Multipliers for Non-Convex Non-Smooth Optimization

In this paper, we propose an algorithmic framework dubbed inertial alter...
research
07/19/2020

Solving the Global Optimum of a Class of Minimization Problem

We study a special nonconvex optimization problem with a single spherica...
research
07/29/2021

A Preconditioned Alternating Minimization Framework for Nonconvex and Half Quadratic Optimization

For some typical and widely used non-convex half-quadratic regularizatio...
research
06/28/2019

Accelerated Symmetric ADMM and Its Applications in Signal Processing

The alternating direction method of multipliers (ADMM) were extensively ...
research
01/10/2023

A Newton-CG based barrier-augmented Lagrangian method for general nonconvex conic optimization

In this paper we consider finding an approximate second-order stationary...
research
11/01/2020

Hierarchical ADMM for Nonconvex Cooperative Distributed Model Predictive Control

Distributed optimization is often widely attempted and innovated as an a...
research
05/11/2022

An Inexact Augmented Lagrangian Algorithm for Training Leaky ReLU Neural Network with Group Sparsity

The leaky ReLU network with a group sparse regularization term has been ...

Please sign up or login with your details

Forgot password? Click here to reset