Solving irreducible stochastic mean-payoff games and entropy games by relative Krasnoselskii-Mann iteration

05/03/2023
by   Marianne Akian, et al.
0

We analyse an algorithm solving stochastic mean-payoff games, combining the ideas of relative value iteration and of Krasnoselskii-Mann damping. We derive parameterized complexity bounds for several classes of games satisfying irreducibility conditions. We show in particular that an ϵ-approximation of the value of an irreducible concurrent stochastic game can be computed in a number of iterations in O(|logϵ|) where the constant in the O(·) is explicit, depending on the smallest non-zero transition probabilities. This should be compared with a bound in O(|ϵ|^-1|log(ϵ)|) obtained by Chatterjee and Ibsen-Jensen (ICALP 2014) for the same class of games, and to a O(|ϵ|^-1) bound by Allamigeon, Gaubert, Katz and Skomra (ICALP 2022) for turn-based games. We also establish parameterized complexity bounds for entropy games, a class of matrix multiplication games introduced by Asarin, Cervelle, Degorre, Dima, Horn and Kozyakin. We derive these results by methods of variational analysis, establishing contraction properties of the relative Krasnoselskii-Mann iteration with respect to Hilbert's semi-norm.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/10/2019

The operator approach to entropy games

Entropy games and matrix multiplication games have been recently introdu...
research
09/23/2020

Comparison of Algorithms for Simple Stochastic Games

Simple stochastic games are turn-based 2.5-player zero-sum graph games w...
research
10/09/2021

The GKK Algorithm is the Fastest over Simple Mean-Payoff Games

We study the algorithm of Gurvich, Khachyian and Karzanov (GKK algorithm...
research
08/21/2020

Comparison of Algorithms for Simple Stochastic Games (Full Version)

Simple stochastic games are turn-based 2.5-player zero-sum graph games w...
research
02/09/2021

A Generic Strategy Iteration Method for Simple Stochastic Games

We present a generic strategy iteration algorithm (GSIA) to find an opti...
research
06/17/2022

Universal Complexity Bounds Based on Value Iteration and Application to Entropy Games

We develop value iteration-based algorithms to solve in a unified manner...
research
07/15/2020

Widest Paths and Global Propagation in Bounded Value Iteration for Stochastic Games

Solving stochastic games with the reachability objective is a fundamenta...

Please sign up or login with your details

Forgot password? Click here to reset