On The Convergence of a Nash Seeking Algorithm with Stochastic State Dependent Payoff

09/30/2012
by   A. F. Hanif, et al.
0

Distributed strategic learning has been getting attention in recent years. As systems become distributed finding Nash equilibria in a distributed fashion is becoming more important for various applications. In this paper, we develop a distributed strategic learning framework for seeking Nash equilibria under stochastic state-dependent payoff functions. We extend the work of Krstic et.al. in [1] to the case of stochastic state dependent payoff functions. We develop an iterative distributed algorithm for Nash seeking and examine its convergence to a limiting trajectory defined by an Ordinary Differential Equation (ODE). We show convergence of our proposed algorithm for vanishing step size and provide an error bound for fixed step size. Finally, we conduct a stability analysis and apply the proposed scheme in a generic wireless networks. We also present numerical results which corroborate our claim.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/25/2019

A damped forward-backward algorithm for stochastic generalized Nash equilibrium seeking

We consider a stochastic generalized Nash equilibrium problem (GNEP) wit...
research
01/11/2023

Bayesian Nash Equilibrium Seeking for Distributed Incomplete-information Aggregative Games

In this paper, we consider a distributed Bayesian Nash equilibrium (BNE)...
research
12/09/2019

Distributed Forward-Backward algorithms for stochastic generalized Nash equilibrium seeking

We consider the stochastic generalized Nash equilibrium problem (SGNEP) ...
research
09/14/2023

Nash equilibrium seeking over digraphs with row-stochastic matrices and network-independent step-sizes

In this paper, we address the challenge of Nash equilibrium (NE) seeking...
research
01/14/2019

An asynchronous, forward-backward, distributed generalized Nash equilibrium seeking algorithm

In this paper, we propose an asynchronous distributed algorithm for the ...
research
09/18/2017

Stochastic Stability of Reinforcement Learning in Positive-Utility Games

This paper considers a class of discrete-time reinforcement-learning dyn...
research
10/09/2022

A Concentration Bound for Distributed Stochastic Approximation

We revisit the classical model of Tsitsiklis, Bertsekas and Athans for d...

Please sign up or login with your details

Forgot password? Click here to reset