Evaluating Strategy Exploration in Empirical Game-Theoretic Analysis

05/21/2021
by   Yongzhao Wang, et al.
0

In empirical game-theoretic analysis (EGTA), game models are extended iteratively through a process of generating new strategies based on learning from experience with prior strategies. The strategy exploration problem in EGTA is how to direct this process so to construct effective models with minimal iteration. A variety of approaches have been proposed in the literature, including methods based on classic techniques and novel concepts. Comparing the performance of these alternatives can be surprisingly subtle, depending sensitively on criteria adopted and measures employed. We investigate some of the methodological considerations in evaluating strategy exploration, defining key distinctions and identifying a few general principles based on examples and experimental observations. In particular, we emphasize the fact that empirical games create a space of strategies that should be evaluated as a whole. Based on this fact, we suggest that the minimum regret constrained profile (MRCP) provides a particularly robust basis for evaluating a space of strategies, and propose a local search method for MRCP that outperforms previous approaches. However, the computation of MRCP is not always feasible especially in large games. In this scenario, we highlight consistency considerations for comparing across different approaches. Surprisingly, we find that recent works violate these considerations that are necessary for evaluation, which may result in misleading conclusions on the performance of different approaches. For proper evaluation, we propose a new evaluation scheme and demonstrate that our scheme can reveal the true learning performance of different approaches compared to previous evaluation methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/09/2023

Regularization for Strategy Exploration in Empirical Game-Theoretic Analysis

In iterative approaches to empirical game-theoretic analysis (EGTA), the...
research
02/24/2020

Efficient exploration of zero-sum stochastic games

We investigate the increasingly important and common game-solving settin...
research
12/02/2021

Empirical Game-Theoretic Analysis in Mean Field Games

We present a simulation-based approach for solution of mean field games ...
research
02/02/2023

Exploiting Extensive-Form Structure in Empirical Game-Theoretic Analysis

Empirical game-theoretic analysis (EGTA) is a general framework for reas...
research
05/29/2018

Beyond admissibility: Dominance between chains of strategies

Admissible strategies, i.e. those that are not dominated by any other st...
research
01/16/2020

A meta analysis of tournaments and an evaluation of performance in the Iterated Prisoner's Dilemma

The Iterated Prisoner's Dilemma has been used for decades as a model of ...

Please sign up or login with your details

Forgot password? Click here to reset