Safe Search for Stackelberg Equilibria in Extensive-Form Games

02/02/2021
by   Chun Kai Ling, et al.
0

Stackelberg equilibrium is a solution concept in two-player games where the leader has commitment rights over the follower. In recent years, it has become a cornerstone of many security applications, including airport patrolling and wildlife poaching prevention. Even though many of these settings are sequential in nature, existing techniques pre-compute the entire solution ahead of time. In this paper, we present a theoretically sound and empirically effective way to apply search, which leverages extra online computation to improve a solution, to the computation of Stackelberg equilibria in general-sum games. Instead of the leader attempting to solve the full game upfront, an approximate "blueprint" solution is first computed offline and is then improved online for the particular subgames encountered in actual play. We prove that our search technique is guaranteed to perform no worse than the pre-computed blueprint strategy, and empirically demonstrate that it enables approximately solving significantly larger games compared to purely offline methods. We also show that our search operation may be cast as a smaller Stackelberg problem, making our method complementary to existing algorithms based on strategy generation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/28/2015

Computation of Stackelberg Equilibria of Finite Sequential Games

The Stackelberg equilibrium solution concept describes optimal strategie...
research
11/03/2021

Computing Stackelberg Equilibrium with Memory in Sequential Games

Stackelberg equilibrium is a solution concept that describes optimal str...
research
06/04/2019

Convergence of Learning Dynamics in Stackelberg Games

This paper investigates the convergence of learning dynamics in Stackelb...
research
12/29/2022

Safe Subgame Resolving for Extensive Form Correlated Equilibrium

Correlated Equilibrium is a solution concept that is more general than N...
research
09/09/2019

Double-oracle sampling method for Stackelberg Equilibrium approximation in general-sum extensive-form games

The paper presents a new method for approximating Strong Stackelberg Equ...
research
02/07/2023

Uncoupled Learning of Differential Stackelberg Equilibria with Commitments

A natural solution concept for many multiagent settings is the Stackelbe...
research
06/10/2021

Subgame solving without common knowledge

In imperfect-information games, subgame solving is significantly more ch...

Please sign up or login with your details

Forgot password? Click here to reset