Accelerated Methods for Riemannian Min-Max Optimization Ensuring Bounded Geometric Penalties

05/25/2023
by   David Martinez Rubio, et al.
0

In this work, we study optimization problems of the form min_x max_y f(x, y), where f(x, y) is defined on a product Riemannian manifold ℳ×𝒩 and is μ_x-strongly geodesically convex (g-convex) in x and μ_y-strongly g-concave in y, for μ_x, μ_y ≥ 0. We design accelerated methods when f is (L_x, L_y, L_xy)-smooth and ℳ, 𝒩 are Hadamard. To that aim we introduce new g-convex optimization results, of independent interest: we show global linear convergence for metric-projected Riemannian gradient descent and improve existing accelerated methods by reducing geometric constants. Additionally, we complete the analysis of two previous works applying to the Riemannian min-max case by removing an assumption about iterates staying in a pre-specified compact set.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/04/2022

First-Order Algorithms for Min-Max Optimization in Geodesic Metric Spaces

From optimal transport to robust dimensionality reduction, a plethora of...
research
11/26/2022

Accelerated Riemannian Optimization: Handling Constraints with a Prox to Bound Geometric Penalties

We propose a globally-accelerated, first-order method for the optimizati...
research
12/11/2018

On the Curved Geometry of Accelerated Optimization

In this work we propose a differential geometric motivation for Nesterov...
research
04/25/2022

Accelerated Multiplicative Weights Update Avoids Saddle Points almost always

We consider non-convex optimization problems with constraint that is a p...
research
06/07/2018

Towards Riemannian Accelerated Gradient Methods

We propose a Riemannian version of Nesterov's Accelerated Gradient algor...
research
01/24/2020

From Nesterov's Estimate Sequence to Riemannian Acceleration

We propose the first global accelerated gradient method for Riemannian m...
research
01/14/2021

No-go Theorem for Acceleration in the Hyperbolic Plane

In recent years there has been significant effort to adapt the key tools...

Please sign up or login with your details

Forgot password? Click here to reset