Stochastic Stackelberg games

05/05/2020
by   Deepanshu Vasal, et al.
0

In this paper, we consider a discrete-time stochastic Stackelberg game where there is a defender (also called leader) who has to defend a target and an attacker (also called follower). Both attacker and defender have conditionally independent private types, conditioned on action and previous state, that evolve as controlled Markov processes. The objective is to compute the stochastic Stackelberg equilibrium of the game where defender commits to a strategy. The attacker's strategy is the best response to the defender strategy and defender's strategy is optimum given the attacker plays the best response. In general, computing such equilibrium involves solving a fixed-point equation for the whole game. In this paper, we present an algorithm that computes such strategies by solving smaller fixed-point equations for each time t. This reduces the computational complexity of the problem from double exponential in time to linear in time. Based on this algorithm, we compute stochastic Stackelberg equilibrium of a security example.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/05/2023

Zero-Determinant Strategy in Stochastic Stackelberg Asymmetric Security Game

In a stochastic Stackelberg asymmetric security game, the strong Stackel...
research
05/24/2020

Model-free Reinforcement Learning for Stochastic Stackelberg Security Games

In this paper, we consider a sequential stochastic Stackelberg game with...
research
09/06/2023

Scalable Learning of Intrusion Responses through Recursive Decomposition

We study automated intrusion response for an IT infrastructure and formu...
research
02/21/2020

Green Security Game with Community Engagement

While game-theoretic models and algorithms have been developed to combat...
research
10/17/2021

Dynamic Tolling for Inducing Socially Optimal Traffic Loads

How to design tolls that induce socially optimal traffic loads with dyna...
research
07/28/2020

On the Characterization of Saddle Point Equilibrium for Security Games with Additive Utility

In this work, we investigate a security game between an attacker and a d...
research
06/10/2023

The Defense of Networked Targets in General Lotto games

Ensuring the security of networked systems is a significant problem, con...

Please sign up or login with your details

Forgot password? Click here to reset