An Overview for Markov Decision Processes in Queues and Networks

07/24/2019
by   Quan-Lin Li, et al.
0

Markov decision processes (MDPs) in queues and networks have been an interesting topic in many practical areas since the 1960s. This paper provides a detailed overview on this topic and tracks the evolution of many basic results. Also, this paper summarizes several interesting directions in the future research. We hope that this overview can shed light to MDPs in queues and networks, and also to their extensive applications in various practical areas.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/30/2015

A Notation for Markov Decision Processes

This paper specifies a notation for Markov decision processes....
research
09/15/2021

Balancing detectability and performance of attacks on the control channel of Markov Decision Processes

We investigate the problem of designing optimal stealthy poisoning attac...
research
11/29/2022

Performance Evaluation, Optimization and Dynamic Decision in Blockchain Systems: A Recent Overview

With rapid development of blockchain technology as well as integration o...
research
07/13/2018

On the Complexity of Iterative Tropical Computation with Applications to Markov Decision Processes

We study the complexity of evaluating powered functions implemented by s...
research
03/12/2021

On Incorporating Forecasts into Linear State Space Model Markov Decision Processes

Weather forecast information will very likely find increasing applicatio...
research
08/24/2023

Optimal data pooling for shared learning in maintenance operations

This paper addresses the benefits of pooling data for shared learning in...
research
03/10/2023

Decision-Making Under Uncertainty: Beyond Probabilities

This position paper reflects on the state-of-the-art in decision-making ...

Please sign up or login with your details

Forgot password? Click here to reset