Solving Non-Convex Non-Concave Min-Max Games Under Polyak-Łojasiewicz Condition

12/07/2018
by   Maziar Sanjabi, et al.
0

In this short note, we consider the problem of solving a min-max zero-sum game. This problem has been extensively studied in the convex-concave regime where the global solution can be computed efficiently. Recently, there have also been developments for finding the first order stationary points of the game when one of the player's objective is concave or (weakly) concave. This work focuses on the non-convex non-concave regime where the objective of one of the players satisfies Polyak-Łojasiewicz (PL) Condition. For such a game, we show that a simple multi-step gradient descent-ascent algorithm finds an ε--first order stationary point of the problem in O(ε^-2) iterations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/28/2020

Solving a class of non-convex min-max games using iterative first order methods

Recent applications that arise in machine learning have surged significa...
research
01/13/2021

Solving Min-Max Optimization with Hidden Structure via Gradient Descent Ascent

Many recent AI architectures are inspired by zero-sum games, however, th...
research
10/28/2019

Poincaré Recurrence, Cycles and Spurious Equilibria in Gradient-Descent-Ascent for Non-Convex Non-Concave Zero-Sum Games

We study a wide class of non-convex non-concave min-max games that gener...
research
02/27/2020

Optimality and Stability in Non-Convex-Non-Concave Min-Max Optimization

Convergence to a saddle point for convex-concave functions has been stud...
research
10/31/2019

A Decentralized Proximal Point-type Method for Saddle Point Problems

In this paper, we focus on solving a class of constrained non-convex non...
research
05/21/2018

Understanding Self-Paced Learning under Concave Conjugacy Theory

By simulating the easy-to-hard learning manners of humans/animals, the l...
research
03/18/2020

Solving Non-Convex Non-Differentiable Min-Max Games using Proximal Gradient Method

Min-max saddle point games appear in a wide range of applications in mac...

Please sign up or login with your details

Forgot password? Click here to reset