Game Theoretic Optimization via Gradient-based Nikaido-Isoda Function

05/15/2019
by   Arvind U. Raghunathan, et al.
0

Computing Nash equilibrium (NE) of multi-player games has witnessed renewed interest due to recent advances in generative adversarial networks. However, computing equilibrium efficiently is challenging. To this end, we introduce the Gradient-based Nikaido-Isoda (GNI) function which serves: (i) as a merit function, vanishing only at the first-order stationary points of each player's optimization problem, and (ii) provides error bounds to a stationary Nash point. Gradient descent is shown to converge sublinearly to a first-order stationary point of the GNI function. For the particular case of bilinear min-max games and multi-player quadratic games, the GNI function is convex. Hence, the application of gradient descent in this case yields linear convergence to an NE (when one exists). In our numerical experiments, we observe that the GNI formulation always converges to the first-order stationary point of each player's optimization problem.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/26/2019

Finding Mixed Strategy Nash Equilibrium for Continuous Games through Deep Learning

Nash equilibrium has long been a desired solution concept in multi-playe...
research
11/07/2021

Teamwork makes von Neumann work: Min-Max Optimization in Two-Team Zero-Sum Games

Motivated by recent advances in both theoretical and applied aspects of ...
research
10/26/2020

LEAD: Least-Action Dynamics for Min-Max Optimization

Adversarial formulations such as generative adversarial networks (GANs) ...
research
06/22/2020

A Provably Convergent and Practical Algorithm for Min-max Optimization with Applications to GANs

We present a new algorithm for optimizing min-max loss functions that ar...
research
01/28/2020

Solving a class of non-convex min-max games using iterative first order methods

Recent applications that arise in machine learning have surged significa...
research
02/15/2018

The Mechanics of n-Player Differentiable Games

The cornerstone underpinning deep learning is the guarantee that gradien...
research
05/28/2021

Discretization Drift in Two-Player Games

Gradient-based methods for two-player games produce rich dynamics that c...

Please sign up or login with your details

Forgot password? Click here to reset