Learning Strategic Value and Cooperation in Multi-Player Stochastic Games through Side Payments

03/09/2023
by   Alan Kuhnle, et al.
0

For general-sum, n-player, strategic games with transferable utility, the Harsanyi-Shapley value provides a computable method to both 1) quantify the strategic value of a player; and 2) make cooperation rational through side payments. We give a simple formula to compute the HS value in normal-form games. Next, we provide two methods to generalize the HS values to stochastic (or Markov) games, and show that one of them may be computed using generalized Q-learning algorithms. Finally, an empirical validation is performed on stochastic grid-games with three or more players. Source code is provided to compute HS values for both the normal-form and stochastic game setting.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/04/2022

On the Global Convergence of Stochastic Fictitious Play in Stochastic Games with Turn-based Controllers

This paper presents a learning dynamic with almost sure convergence guar...
research
05/02/2019

Some Structure Properties of Finite Normal-Form Games

Game theory provides a mathematical framework for analysing strategic si...
research
02/09/2018

Balancing Two-Player Stochastic Games with Soft Q-Learning

Within the context of video games the notion of perfectly rational agent...
research
05/18/2023

Game Theory with Simulation of Other Players

Game-theoretic interactions with AI agents could differ from traditional...
research
06/26/2019

Stochastic hybrid differential games and match race problems

We discuss the general framework of a stochastic two-player, hybrid diff...
research
07/22/2021

Hodge theoretic reward allocation for generalized cooperative games on graphs

We define cooperative games on general graphs and generalize Lloyd S. Sh...
research
05/05/2022

General sum stochastic games with networked information flows

Inspired by applications such as supply chain management, epidemics, and...

Please sign up or login with your details

Forgot password? Click here to reset