DeepAI AI Chat
Log In Sign Up

Extragradient with Positive Momentum is Optimal for Games with Cross-Shaped Jacobian Spectrum

11/09/2022
by   Junhyung Lyle Kim, et al.
0

The extragradient method has recently gained increasing attention, due to its convergence behavior on smooth games. In n-player differentiable games, the eigenvalues of the Jacobian of the vector field are distributed on the complex plane, exhibiting more convoluted dynamics compared to classical (i.e., single player) minimization. In this work, we take a polynomial-based analysis of the extragradient with momentum for optimizing games with cross-shaped Jacobian spectrum on the complex plane. We show two results. First, based on the hyperparameter setup, the extragradient with momentum exhibits three different modes of convergence: when the eigenvalues are distributed i) on the real line, ii) both on the real line along with complex conjugates, and iii) only as complex conjugates. Then, we focus on the case ii), i.e., when the eigenvalues of the Jacobian have cross-shaped structure, as observed in training generative adversarial networks. For this problem class, we derive the optimal hyperparameters of the momentum extragradient method, and show that it achieves an accelerated convergence rate.

READ FULL TEXT

page 1

page 2

page 3

page 4

02/16/2021

Complex Momentum for Learning in Games

We generalize gradient descent with momentum for learning in differentia...
08/17/2020

On the Suboptimality of Negative Momentum for Minimax Optimization

Smooth game optimization has recently attracted great interest in machin...
01/02/2020

Accelerating Smooth Games by Manipulating Spectral Shapes

We use matrix iteration theory to characterize acceleration in smooth ga...
06/13/2019

A Tight and Unified Analysis of Extragradient for a Whole Spectrum of Differentiable Games

We consider differentiable games: multi-objective minimization problems,...
10/05/2020

Average-case Acceleration for Bilinear Games and Normal Matrices

Advances in generative modeling and adversarial learning have given rise...
09/30/2021

Electronic Observables for Relaxed Bilayer 2D Heterostructures in Momentum Space

We generalize the transformations and duality found in incommensurate 2D...