Safety Verification of Model Based Reinforcement Learning Controllers

10/21/2020
by   Akshita Gupta, et al.
33

Model-based reinforcement learning (RL) has emerged as a promising tool for developing controllers for real world systems (e.g., robotics, autonomous driving, etc.). However, real systems often have constraints imposed on their state space which must be satisfied to ensure the safety of the system and its environment. Developing a verification tool for RL algorithms is challenging because the non-linear structure of neural networks impedes analytical verification of such models or controllers. To this end, we present a novel safety verification framework for model-based RL controllers using reachable set analysis. The proposed frame-work can efficiently handle models and controllers which are represented using neural networks. Additionally, if a controller fails to satisfy the safety constraints in general, the proposed framework can also be used to identify the subset of initial states from which the controller can be safely executed.

READ FULL TEXT
research
03/21/2019

End-to-End Safe Reinforcement Learning through Barrier Functions for Safety-Critical Continuous Control Tasks

Reinforcement Learning (RL) algorithms have found limited success beyond...
research
10/20/2020

Runtime Safety Assurance Using Reinforcement Learning

The airworthiness and safety of a non-pedigreed autopilot must be verifi...
research
09/12/2020

Extended Radial Basis Function Controller for Reinforcement Learning

There have been attempts in model-based reinforcement learning to exploi...
research
06/05/2019

A Generic Synchronous Dataflow Architecture to Rapidly Prototype and Deploy Robot Controllers

The paper presents a software architecture to optimize the process of pr...
research
03/11/2022

Deep Binary Reinforcement Learning for Scalable Verification

The use of neural networks as function approximators has enabled many ad...
research
04/20/2021

Scalable Synthesis of Verified Controllers in Deep Reinforcement Learning

There has been significant recent interest in devising verification tech...
research
06/05/2023

Conformal Predictive Safety Filter for RL Controllers in Dynamic Environments

The interest in using reinforcement learning (RL) controllers in safety-...

Please sign up or login with your details

Forgot password? Click here to reset