Accelerated Algorithms for a Class of Optimization Problems with Equality and Box Constraints

05/08/2023
by   Anjali Parashar, et al.
0

Convex optimization with equality and inequality constraints is a ubiquitous problem in several optimization and control problems in large-scale systems. Recently there has been a lot of interest in establishing accelerated convergence of the loss function. A class of high-order tuners was recently proposed in an effort to lead to accelerated convergence for the case when no constraints are present. In this paper, we propose a new high-order tuner that can accommodate the presence of equality constraints. In order to accommodate the underlying box constraints, time-varying gains are introduced in the high-order tuner which leverage convexity and ensure anytime feasibility of the constraints. Numerical examples are provided to support the theoretical derivations.

READ FULL TEXT
research
11/19/2020

A Stable High-order Tuner for General Convex Functions

Iterative gradient-based algorithms have been increasingly applied for t...
research
03/23/2021

A High-order Tuner for Accelerated Learning and Control

Gradient-descent based iterative algorithms pervade a variety of problem...
research
05/04/2020

Accelerated Learning with Robustness to Adversarial Regressors

High order iterative momentum-based parameter update algorithms have see...
research
09/08/2020

Accelerated Multi-Agent Optimization Method over Stochastic Networks

We propose a distributed method to solve a multi-agent optimization prob...
research
09/16/2019

An algorithm based on continuation techniques for minimization problems with highly non-linear equality constraints

We present an algorithm based on continuation techniques that can be app...
research
05/25/2005

Handling equality constraints by adaptive relaxing rule for swarm algorithms

The adaptive constraints relaxing rule for swarm algorithms to handle wi...
research
01/26/2021

Large-scale Optimization with Linear Equality Constraints using Reduced Compact Representation

For optimization problems with sparse linear equality constraints, we ob...

Please sign up or login with your details

Forgot password? Click here to reset