Tolling for Constraint Satisfaction in Markov Decision Process Congestion Games

03/02/2019
by   Sarah H. Q. Li, et al.
0

Markov decision process (MDP) congestion game is an extension of classic congestion games, where a continuous population of selfish agents solves Markov decision processes with congestion: the payoff of a strategy decreases as more population uses it. We draw parallels between key concepts from capacitated congestion games and MDP. In particular, we show that population mass constraints in MDP congestion games are equivalent to imposing tolls/incentives on the reward function, which can be utilized by social planners to achieve auxiliary objectives. We demonstrate such methods in a simulated Seattle ride-share model, where tolls and incentives are enforced for two separate objectives: to guarantee minimum driver density in downtown Seattle, and to shift the game equilibrium towards a maximum social output.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/21/2019

Online Constraint Satisfaction via Tolls in MDP Congestion Games

We consider the toll design problem that arise for a game designer of a ...
research
09/09/2019

Sensitivity Analysis for Markov Decision Process Congestion Games

We consider a non-atomic congestion game where each decision maker perfo...
research
05/10/2021

Fast constraint satisfaction problem and learning-based algorithm for solving Minesweeper

Minesweeper is a popular spatial-based decision-making game that works w...
research
10/16/2012

Toward Large-Scale Agent Guidance in an Urban Taxi Service

Empty taxi cruising represents a wastage of resources in the context of ...
research
05/23/2019

Where to Find Next Passengers on E-hailing Platforms? - A Markov Decision Process Approach

Vacant taxi drivers' passenger seeking process in a road network generat...
research
06/23/2022

Formalizing the Problem of Side Effect Regularization

AI objectives are often hard to specify properly. Some approaches tackle...
research
04/27/2023

Level Assembly as a Markov Decision Process

Many games feature a progression of levels that doesn't adapt to the pla...

Please sign up or login with your details

Forgot password? Click here to reset