Verification and Control of Turn-Based Probabilistic Real-Time Games

06/21/2019
by   Marta Kwiatkowska, et al.
0

Quantitative verification techniques have been developed for the formal analysis of a variety of probabilistic models, such as Markov chains, Markov decision process and their variants. They can be used to produce guarantees on quantitative aspects of system behaviour, such as safety, reliability and performance, or to help synthesise controllers that ensure such guarantees are met. We propose the model of turn-based probabilistic timed multi-player games, which incorporates probabilistic choice, real-time clocks and nondeterministic behaviour across multiple players. Building on the digital clocks approach for the simpler model of probabilistic timed automata, we show how to compute the key measures that underlie quantitative verification, namely the probability and expected cumulative price to reach a target. We illustrate this on case studies from computer security and task scheduling.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/11/2020

Automatic Verification of Concurrent Stochastic Systems

Automated verification techniques for stochastic games allow formal reas...
research
03/01/2021

Generating Probabilistic Safety Guarantees for Neural Network Controllers

Neural networks serve as effective controllers in a variety of complex s...
research
05/14/2020

Probabilistic Guarantees for Safe Deep Reinforcement Learning

Deep reinforcement learning has been successfully applied to many contro...
research
09/17/2019

Verifying Reachability Properties in Markov Chains via Incremental Induction

There is a scalability gap between probabilistic and non-probabilistic v...
research
04/27/2023

Level Assembly as a Markov Decision Process

Many games feature a progression of levels that doesn't adapt to the pla...
research
01/20/2020

Quantitative Aspects of Programming Languages and Systems over the past 2^4 years and beyond

Quantitative aspects of computation are related to the use of both physi...
research
03/18/2022

An Overview of Modest Models and Tools for Real Stochastic Timed Systems

We depend on the safe, reliable, and timely operation of cyber-physical ...

Please sign up or login with your details

Forgot password? Click here to reset