Synthesize Efficient Safety Certificates for Learning-Based Safe Control using Magnitude Regularization

09/23/2022
by   Haotian Zheng, et al.
0

Energy-function-based safety certificates can provide provable safety guarantees for the safe control tasks of complex robotic systems. However, all recent studies about learning-based energy function synthesis only consider the feasibility, which might cause over-conservativeness and result in less efficient controllers. In this work, we proposed the magnitude regularization technique to improve the efficiency of safe controllers by reducing the conservativeness inside the energy function while keeping the promising provable safety guarantees. Specifically, we quantify the conservativeness by the magnitude of the energy function, and we reduce the conservativeness by adding a magnitude regularization term to the synthesis loss. We propose the SafeMR algorithm that uses reinforcement learning (RL) for the synthesis to unify the learning processes of safe controllers and energy functions. Experimental results show that the proposed method does reduce the conservativeness of the energy functions and outperforms the baselines in terms of the controller efficiency while guaranteeing safety.

READ FULL TEXT

page 5

page 6

research
11/15/2021

Joint Synthesis of Safety Certificate and Safe Control Policy using Constrained Reinforcement Learning

Safety is the major consideration in controlling complex dynamical syste...
research
12/19/2019

Safe Adaptation Using Energy Functions

Adaptation has long been considered to be an important capability for au...
research
06/27/2023

Safety using Analytically Constructed Density Functions

This paper presents a novel approach for safe control synthesis using th...
research
09/14/2021

Safe Nonlinear Control Using Robust Neural Lyapunov-Barrier Functions

Safety and stability are common requirements for robotic control systems...
research
01/10/2019

Automated Synthesis of Safe Digital Controllers for Sampled-Data Stochastic Nonlinear Systems

We present a new method for the automated synthesis of digital controlle...
research
06/16/2020

ShieldNN: A Provably Safe NN Filter for Unsafe NN Controllers

In this paper, we consider the problem of creating a safe-by-design Rect...
research
05/12/2022

Contingency-constrained economic dispatch with safe reinforcement learning

Future power systems will rely heavily on micro grids with a high share ...

Please sign up or login with your details

Forgot password? Click here to reset