Double Oracle Algorithm for Computing Equilibria in Continuous Games

09/25/2020
by   Lukáš Adam, et al.
0

Many efficient algorithms have been designed to recover Nash equilibria of various classes of finite games. Special classes of continuous games with infinite strategy spaces, such as polynomial games, can be solved by semidefinite programming. In general, however, continuous games are not directly amenable to computational procedures. In this contribution, we develop an iterative strategy generation technique for finding a Nash equilibrium in a whole class of continuous two-person zero-sum games with compact strategy sets. The procedure, which is called the double oracle algorithm, has been successfully applied to large finite games in the past. We prove the convergence of the double oracle algorithm to a Nash equilibrium. Moreover, the algorithm is guaranteed to recover an approximate equilibrium in finitely-many steps. Our numerical experiments show that it outperforms fictitious play on several examples of games appearing in the literature. In particular, we provide a detailed analysis of experiments with a version of the continuous Colonel Blotto game.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/09/2021

Multiple Oracle Algorithm For General-Sum Continuous Games

Continuous games have compact strategy sets and continuous utility funct...
research
05/19/2021

Modeling Precomputation In Games Played Under Computational Constraints

Understanding the properties of games played under computational constra...
research
03/11/2021

XDO: A Double Oracle Algorithm for Extensive-Form Games

Policy Space Response Oracles (PSRO) is a deep reinforcement learning al...
research
01/19/2022

Anytime PSRO for Two-Player Zero-Sum Games

Policy space response oracles (PSRO) is a multi-agent reinforcement lear...
research
03/13/2021

Online Double Oracle

Solving strategic games with huge action space is a critical yet under-e...
research
08/24/2023

SC-PSRO: A Unified Strategy Learning Method for Normal-form Games

Solving Nash equilibrium is the key challenge in normal-form games with ...
research
11/16/2022

Some Properties of the Nash Equilibrium in 2 × 2 Zero-Sum Games

In this report, some properties of the set of Nash equilibria (NEs) of 2...

Please sign up or login with your details

Forgot password? Click here to reset