Trilevel and Multilevel Optimization using Monotone Operator Theory

05/19/2021
by   Allahkaram Shafiei, et al.
0

We consider rather a general class of multi-level optimization problems, where a convex objective function is to be minimized, subject to constraints to optima of a nested convex optimization problem. As a special case, we consider a trilevel optimization problem, where the objective of the two lower layers consists of a sum of a smooth and a non-smooth term. Based on fixed-point theory and related arguments, we present a natural first-order algorithm and analyze its convergence and rates of convergence in several regimes of parameters.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/30/2023

Single-Loop Switching Subgradient Methods for Non-Smooth Weakly Convex Optimization with Non-Smooth Convex Constraints

In this paper, we consider a general non-convex constrained optimization...
research
05/07/2019

Convergence Rate of Distributed Optimization Algorithms Based on Gradient Tracking

We study distributed, strongly convex and nonconvex, multiagent optimiza...
research
08/24/2020

Stochastic Multi-level Composition Optimization Algorithms with Level-Independent Convergence Rates

In this paper, we study smooth stochastic multi-level composition optimi...
research
06/17/2022

Generalized Frank-Wolfe Algorithm for Bilevel Optimization

In this paper, we study a class of bilevel optimization problems, also k...
research
06/10/2022

Inverting Incomplete Fourier Transforms by a Sparse Regularization Model and Applications in Seismic Wavefield Modeling

We propose a sparse regularization model for inversion of incomplete Fou...
research
09/16/2019

Sinkhorn Algorithm as a Special Case of Stochastic Mirror Descent

We present a new perspective on the celebrated Sinkhorn algorithm by sho...
research
02/14/2023

Multilevel Objective-Function-Free Optimization with an Application to Neural Networks Training

A class of multi-level algorithms for unconstrained nonlinear optimizati...

Please sign up or login with your details

Forgot password? Click here to reset