Complexity and Algorithms for Exploiting Quantal Opponents in Large Two-Player Games

09/30/2020
by   David Milec, et al.
0

Solution concepts of traditional game theory assume entirely rational players; therefore, their ability to exploit subrational opponents is limited. One type of subrationality that describes human behavior well is the quantal response. While there exist algorithms for computing solutions against quantal opponents, they either do not scale or may provide strategies that are even worse than the entirely-rational Nash strategies. This paper aims to analyze and propose scalable algorithms for computing effective and robust strategies against a quantal opponent in normal-form and extensive-form games. Our contributions are: (1) we define two different solution concepts related to exploiting quantal opponents and analyze their properties; (2) we prove that computing these solutions is computationally hard; (3) therefore, we evaluate several heuristic approximations based on scalable counterfactual regret minimization (CFR); and (4) we identify a CFR variant that exploits the bounded opponents better than the previously used variants while being less exploitable by the worst-case perfectly-rational opponent.

READ FULL TEXT
research
02/12/2015

Computing rational decisions in extensive games with limited foresight

We introduce a class of extensive form games where players might not be ...
research
10/01/2019

Mistakes in Games

We define a new concept of "mistake" strategies and actions for strategi...
research
02/13/2021

Efficient Deviation Types and Learning for Hindsight Rationality in Extensive-Form Games

Hindsight rationality is an approach to playing multi-agent, general-sum...
research
01/16/2014

Algorithms for Closed Under Rational Behavior (CURB) Sets

We provide a series of algorithms demonstrating that solutions according...
research
09/20/2018

Solving Large Extensive-Form Games with Strategy Constraints

Extensive-form games are a common model for multiagent interactions with...
research
05/24/2022

Efficient Deviation Types and Learning for Hindsight Rationality in Extensive-Form Games: Corrections

Hindsight rationality is an approach to playing general-sum games that p...
research
12/23/2021

Continual Depth-limited Responses for Computing Counter-strategies in Extensive-form Games

In real-world applications, game-theoretic algorithms often interact wit...

Please sign up or login with your details

Forgot password? Click here to reset