Zero-sum risk-sensitive continuous-time stochastic games with unbounded payoff and transition rates and Borel spaces

03/06/2021
by   Junyu Zhang, et al.
0

We study a finite-horizon two-person zero-sum risk-sensitive stochastic game for continuous-time Markov chains and Borel state and action spaces, in which payoff rates, transition rates and terminal reward functions are allowed to be unbounded from below and from above and the policies can be history-dependent. Under suitable conditions, we establish the existence of a solution to the corresponding Shapley equation (SE) by an approximation technique. Then, by the SE and the extension of the Dynkin's formula, we prove the existence of a Nash equilibrium and verify that the value of the stochastic game is the unique solution to the SE. Moreover, we develop a value iteration-type algorithm for approaching to the value of the stochastic game. The convergence of the algorithm is proved by a special contraction operator in our risk-sensitive stochastic game. Finally, we demonstrate our main results by two examples.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/06/2021

Zero-Sum Semi-Markov Games with State-Action-Dependent Discount Factors

Semi-Markov model is one of the most general models for stochastic dynam...
research
11/25/2022

Zero-Sum Stochastic Stackelberg Games

Zero-sum stochastic games have found important applications in a variety...
research
10/28/2011

Risk-sensitive Markov control processes

We introduce a general framework for measuring risk in the context of Ma...
research
08/02/2022

A Differential Game Control Problem in Finite Horizon with an Application to Portfolio Optimization

This paper considers a new class of deterministic finite-time horizon, t...
research
07/10/2020

Finding Equilibrium in Multi-Agent Games with Payoff Uncertainty

We study the problem of finding equilibrium strategies in multi-agent ga...
research
01/29/2022

On Non-Cooperative Perfect Information Semi-Markov Games

We show that an N-person non-cooperative semi-Markov game under limiting...
research
01/01/2019

A Theoretical Analysis of Deep Q-Learning

Despite the great empirical success of deep reinforcement learning, its ...

Please sign up or login with your details

Forgot password? Click here to reset