Neural Certificates for Safe Control Policies

06/15/2020
by   Wanxin Jin, et al.
0

This paper develops an approach to learn a policy of a dynamical system that is guaranteed to be both provably safe and goal-reaching. Here, the safety means that a policy must not drive the state of the system to any unsafe region, while the goal-reaching requires the trajectory of the controlled system asymptotically converges to a goal region (a generalization of stability). We obtain the safe and goal-reaching policy by jointly learning two additional certificate functions: a barrier function that guarantees the safety and a developed Lyapunov-like function to fulfill the goal-reaching requirement, both of which are represented by neural networks. We show the effectiveness of the method to learn both safe and goal-reaching policies on various systems, including pendulums, cart-poles, and UAVs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/24/2021

Towards Safe Continuing Task Reinforcement Learning

Safety is a critical feature of controller design for physical systems. ...
research
01/16/2022

Zero Botnets: An Observe-Pursue-Counter Approach

Adversarial Internet robots (botnets) represent a growing threat to the ...
research
06/30/2022

On the Learning and Learnablity of Quasimetrics

Our world is full of asymmetries. Gravity and wind can make reaching a p...
research
02/24/2020

Safe reinforcement learning for probabilistic reachability and safety specifications: A Lyapunov-based approach

Emerging applications in robotics and autonomous systems, such as autono...
research
05/15/2019

Improved Safe Real-time Heuristic Search

A fundamental concern in real-time planning is the presence of dead-ends...
research
10/11/2022

Learning Control Policies for Region Stabilization in Stochastic Systems

We consider the problem of learning control policies in stochastic syste...
research
11/20/2022

Safe Control Under Input Limits with Neural Control Barrier Functions

We propose new methods to synthesize control barrier function (CBF)-base...

Please sign up or login with your details

Forgot password? Click here to reset