Multi-weighted Markov Decision Processes with Reachability Objectives

09/10/2018
by   Patricia Bouyer, et al.
0

In this paper, we are interested in the synthesis of schedulers in double-weighted Markov decision processes, which satisfy both a percentile constraint over a weighted reachability condition, and a quantitative constraint on the expected value of a random variable defined using a weighted reachability condition. This problem is inspired by the modelization of an electric-vehicle charging problem. We study the cartography of the problem, when one parameter varies, and show how a partial cartography can be obtained via two sequences of opimization problems. We discuss completeness and feasability of the method.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/28/2020

The Complexity of Reachability in Parametric Markov Decision Processes

This article presents the complexity of reachability decision problems f...
research
05/16/2023

Bi-Objective Lexicographic Optimization in Markov Decision Processes with Related Objectives

We consider lexicographic bi-objective problems on Markov Decision Proce...
research
07/06/2023

Exploiting Adjoints in Property Directed Reachability Analysis

We formulate, in lattice-theoretic terms, two novel algorithms inspired ...
research
05/09/2023

Graph-Based Reductions for Parametric and Weighted MDPs

We study the complexity of reductions for weighted reachability in param...
research
02/25/2020

Near Optimal Task Graph Scheduling with Priced Timed Automata and Priced Timed Markov Decision Processes

Task graph scheduling is a relevant problem in computer science with app...
research
06/09/2020

On Decidability of Time-bounded Reachability in CTMDPs

We consider the time-bounded reachability problem for continuous-time Ma...
research
05/14/2020

Qualitative Controller Synthesis for Consumption Markov Decision Processes

Consumption Markov Decision Processes (CMDPs) are probabilistic decision...

Please sign up or login with your details

Forgot password? Click here to reset