Augmented Lagrangian Methods for Time-varying Constrained Online Convex Optimization

05/19/2022
by   Haoyang Liu, et al.
0

In this paper, we consider online convex optimization (OCO) with time-varying loss and constraint functions. Specifically, the decision maker chooses sequential decisions based only on past information, meantime the loss and constraint functions are revealed over time. We first develop a class of model-based augmented Lagrangian methods (MALM) for time-varying functional constrained OCO (without feedback delay). Under standard assumptions, we establish sublinear regret and sublinear constraint violation of MALM. Furthermore, we extend MALM to deal with time-varying functional constrained OCO with delayed feedback, in which the feedback information of loss and constraint functions is revealed to decision maker with delays. Without additional assumptions, we also establish sublinear regret and sublinear constraint violation for the delayed version of MALM. Finally, numerical results for several examples of constrained OCO including online network resource allocation, online logistic regression and online quadratically constrained quadratical program are presented to demonstrate the efficiency of the proposed algorithms.

READ FULL TEXT
research
05/09/2021

Delay-Tolerant Constrained OCO with Application to Network Resource Allocation

We consider online convex optimization (OCO) with multi-slot feedback de...
research
05/01/2021

Regret and Cumulative Constraint Violation Analysis for Distributed Online Constrained Convex Optimization

This paper considers the distributed online convex optimization problem ...
research
03/03/2021

Periodic Updates for Constrained OCO with Application to Large-Scale Multi-Antenna Systems

In many dynamic systems, such as wireless communications, decisions on s...
research
08/07/2023

Non-Convex Bilevel Optimization with Time-Varying Objective Functions

Bilevel optimization has become a powerful tool in a wide variety of mac...
research
01/26/2023

Online Convex Optimization with Stochastic Constraints: Zero Constraint Violation and Bandit Feedback

This paper studies online convex optimization with stochastic constraint...
research
12/09/2022

Online Convex Optimization of Programmable Quantum Computers to Simulate Time-Varying Quantum Channels

Simulating quantum channels is a fundamental primitive in quantum comput...
research
02/16/2022

Online Control of Unknown Time-Varying Dynamical Systems

We study online control of time-varying linear systems with unknown dyna...

Please sign up or login with your details

Forgot password? Click here to reset