Controller Synthesis for Omega-Regular and Steady-State Specifications

06/05/2021
by   Alvaro Velasquez, et al.
0

Given a Markov decision process (MDP) and a linear-time (ω-regular or LTL) specification, the controller synthesis problem aims to compute the optimal policy that satisfies the specification. More recently, problems that reason over the asymptotic behavior of systems have been proposed through the lens of steady-state planning. This entails finding a control policy for an MDP such that the Markov chain induced by the solution policy satisfies a given set of constraints on its steady-state distribution. This paper studies a generalization of the controller synthesis problem for a linear-time specification under steady-state constraints on the asymptotic behavior. We present an algorithm to find a deterministic policy satisfying ω-regular and steady-state constraints by characterizing the solutions as an integer linear program, and experimentally evaluate our approach.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/31/2021

LTL-Constrained Steady-State Policy Synthesis

Decision-making policies for agents are often synthesized with the const...
research
02/13/2018

Parameter and Insertion Function Co-synthesis for Opacity Enhancement in Parametric Stochastic Discrete Event Systems

Opacity is a property that characterizes the system's capability to keep...
research
05/26/2023

MULTIGAIN 2.0: MDP controller synthesis for multiple mean-payoff, LTL and steady-state constraints

We present MULTIGAIN 2.0, a major extension to the controller synthesis ...
research
12/03/2020

Verifiable Planning in Expected Reward Multichain MDPs

The planning domain has experienced increased interest in the formal syn...
research
04/25/2022

Strategy Synthesis for Global Window PCTL

Given a Markov decision process (MDP) M and a formula Φ, the strategy sy...
research
07/09/2018

Entropy Maximization for Markov Decision Processes Under Temporal Logic Constraints

We study the problem of synthesizing a policy that maximizes the entropy...
research
02/19/2021

Controller Synthesis for Golog Programs over Finite Domains with Metric Temporal Constraints

Executing a Golog program on an actual robot typically requires addition...

Please sign up or login with your details

Forgot password? Click here to reset