It's Time to Play Safe: Shield Synthesis for Timed Systems

06/30/2020
by   Roderick Bloem, et al.
0

Erroneous behaviour in safety critical real-time systems may inflict serious consequences. In this paper, we show how to synthesize timed shields from timed safety properties given as timed automata. A timed shield enforces the safety of a running system while interfering with the system as little as possible. We present timed post-shields and timed pre-shields. A timed pre-shield is placed before the system and provides a set of safe outputs. This set restricts the choices of the system. A timed post-shield is implemented after the system. It monitors the system and corrects the system's output only if necessary. We further extend the timed post-shield construction to provide a guarantee on the recovery phase, i.e., the time between a specification violation and the point at which full control can be handed back to the system. In our experimental results, we use timed post-shields to ensure the safety in a reinforcement learning setting for controlling a platoon of cars, during the learning and execution phase, and study the effect.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/26/2021

TEMPEST – Synthesis Tool for Reactive Systems and Shields in Probabilistic Environments

We present Tempest, a synthesis tool to automatically create correct-by-...
research
04/15/2019

Synthesis of Admissible Shields

Shield synthesis is an approach to enforce a set of safety-critical prop...
research
11/15/2021

Joint Synthesis of Safety Certificate and Safe Control Policy using Constrained Reinforcement Learning

Safety is the major consideration in controlling complex dynamical syste...
research
08/28/2023

Shielded Reinforcement Learning for Hybrid Systems

Safe and optimal controller synthesis for switched-controlled hybrid sys...
research
02/14/2019

Verifiably Safe Off-Model Reinforcement Learning

The desire to use reinforcement learning in safety-critical settings has...
research
07/05/2023

Safety Shielding under Delayed Observation

Agents operating in physical environments need to be able to handle dela...
research
08/29/2017

Safe Reinforcement Learning via Shielding

Reinforcement learning algorithms discover policies that maximize reward...

Please sign up or login with your details

Forgot password? Click here to reset