Barrier Certified Safety Learning Control: When Sum-of-Square Programming Meets Reinforcement Learning

06/16/2022
by   Hejun Huang, et al.
0

Safety guarantee is essential in many engineering implementations. Reinforcement learning provides a useful way to strengthen safety. However, reinforcement learning algorithms cannot completely guarantee safety over realistic operations. To address this issue, this work adopts control barrier functions over reinforcement learning, and proposes a compensated algorithm to completely maintain safety. Specifically, a sum-of-squares programming has been exploited to search for the optimal controller, and tune the learning hyperparameters simultaneously. Thus, the control actions are pledged to be always within the safe region. The effectiveness of proposed method is demonstrated via an inverted pendulum model. Compared to quadratic programming based reinforcement learning methods, our sum-of-squares programming based reinforcement learning has shown its superiority.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/16/2020

Reinforcement Learning for Safety-Critical Control under Model Uncertainty, using Control Lyapunov Functions and Control Barrier Functions

In this paper, the issue of model uncertainty in safety-critical control...
research
09/19/2022

Safety Index Synthesis via Sum-of-Squares Programming

Control systems often need to satisfy strict safety requirements. Safety...
research
04/18/2021

Provably Safe Tolerance Estimation for Robot Arms via Sum-of-Squares Programming

Tolerance estimation problems are prevailing in engineering applications...
research
01/20/2020

Extent-Compatible Control Barrier Functions

Safety requirements in dynamical systems are commonly enforced with set ...
research
11/21/2020

Neural Network iLQR: A New Reinforcement Learning Architecture

As a notable machine learning paradigm, the research efforts in the cont...
research
09/26/2022

FORESEE: Model-based Reinforcement Learning using Unscented Transform with application to Tuning of Control Barrier Functions

In this paper, we introduce a novel online model-based reinforcement lea...
research
06/03/2021

Safe RAN control: A Symbolic Reinforcement Learning Approach

In this paper, we present a Symbolic Reinforcement Learning (SRL) based ...

Please sign up or login with your details

Forgot password? Click here to reset