AI Chat AI Image Generator AI Video Text to Speech

Markov Decision Process with an External Temporal Process

05/25/2023

∙

by Ranga Shaarad Ayyagari, et al.

∙

∙

Most reinforcement learning algorithms treat the context under which they operate as a stationary, isolated and undisturbed environment. However, in the real world, the environment is constantly changing due to a variety of external influences. To address this problem, we study Markov Decision Processes (MDP) under the influence of an external temporal process. We formalize this notion and discuss conditions under which the problem becomes tractable with suitable solutions. We propose a policy iteration algorithm to solve this problem and theoretically analyze its performance.

Ranga Shaarad Ayyagari
2 publications
Ambedkar Dukkipati
35 publications

page 1

page 2

page 3

page 4

research

∙ 07/29/2023

Dynamic deep-reinforcement-learning algorithm in Partially Observed Markov Decision Processes

Reinforcement learning has been greatly improved in recent studies and a...

0 Saki Omi, et al. ∙

research

∙ 02/28/2023

Minimizing the Outage Probability in a Markov Decision Process

Standard Markov decision process (MDP) and reinforcement learning algori...

0 Vincent Corlay, et al. ∙

research

∙ 07/02/2019

Learning the Arrow of Time

We humans seem to have an innate understanding of the asymmetric progres...

9 Nasim Rahaman, et al. ∙

research

∙ 07/30/2022

A Bayesian Approach to Learning Bandit Structure in Markov Decision Processes

In the reinforcement learning literature, there are many algorithms deve...

0 Kelly W. Zhang, et al. ∙

research

∙ 09/26/2019

Markov Decision Process for Video Generation

We identify two pathological cases of temporal inconsistencies in video ...

32 Vladyslav Yushchenko, et al. ∙

research

∙ 04/05/2018

Human Intention Recognition in Flexible Robotized Warehouses based on Markov Decision Processes

The rapid growth of e-commerce increases the need for larger warehouses ...

0 Tomislav Petković, et al. ∙

research

∙ 09/30/2021

Learning the Markov Decision Process in the Sparse Gaussian Elimination

We propose a learning-based approach for the sparse Gaussian Elimination...

0 Yingshi Chen, et al. ∙