Min-Max Optimization Made Simple: Approximating the Proximal Point Method via Contraction Maps

01/10/2023
by   Volkan Cevher, et al.
0

In this paper we present a first-order method that admits near-optimal convergence rates for convex/concave min-max problems while requiring a simple and intuitive analysis. Similarly to the seminal work of Nemirovski and the recent approach of Piliouras et al. in normal form games, our work is based on the fact that the update rule of the Proximal Point method (PP) can be approximated up to accuracy ϵ with only O(log 1/ϵ) additional gradient-calls through the iterations of a contraction map. Then combining the analysis of (PP) method with an error-propagation analysis we establish that the resulting first order method, called Clairvoyant Extra Gradient, admits near-optimal time-average convergence for general domains and last-iterate convergence in the unconstrained case.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/20/2020

Halpern Iteration for Near-Optimal and Parameter-Free Monotone Inclusion and Strong Solutions to Variational Inequalities

We leverage the connections between nonexpansive maps, monotone Lipschit...
research
10/22/2020

Adaptive extra-gradient methods for min-max optimization and games

We present a new family of min-max optimization algorithms that automati...
research
06/04/2022

First-Order Algorithms for Min-Max Optimization in Geodesic Metric Spaces

From optimal transport to robust dimensionality reduction, a plethora of...
research
02/17/2020

Last iterate convergence in no-regret learning: constrained min-max optimization for convex-concave landscapes

In a recent series of papers it has been established that variants of Gr...
research
10/23/2022

Explicit Second-Order Min-Max Optimization Methods with Optimal Convergence Guarantee

We propose and analyze exact and inexact regularized Newton-type methods...
research
06/14/2023

Contraction Rate Estimates of Stochastic Gradient Kinetic Langevin Integrators

In previous work, we introduced a method for determining convergence rat...

Please sign up or login with your details

Forgot password? Click here to reset