Safe Approximate Dynamic Programming Via Kernelized Lipschitz Estimation

07/03/2019
by   Ankush Chakrabarty, et al.
0

We develop a method for obtaining safe initial policies for reinforcement learning via approximate dynamic programming (ADP) techniques for uncertain systems evolving with discrete-time dynamics. We employ kernelized Lipschitz estimation and semidefinite programming for computing admissible initial control policies with provably high probability. Such admissible controllers enable safe initialization and constraint enforcement while providing exponential stability of the equilibrium of the closed-loop system.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/02/2020

Differential Dynamic Programming with Nonlinear Safety Constraints Under System Uncertainties

Safe operation of systems such as robots requires them to plan and execu...
research
05/30/2021

Safety Embedded Differential Dynamic Programming using Discrete Barrier States

Certified safe control is a growing challenge in robotics, especially wh...
research
06/26/2019

Approximate Dynamic Programming For Linear Systems with State and Input Constraints

Enforcing state and input constraints during reinforcement learning (RL)...
research
06/05/2020

Logical Team Q-learning: An approach towards factored policies in cooperative MARL

We address the challenge of learning factored policies in cooperative MA...
research
07/06/2020

Near-Linear Time Edit Distance for Indel Channels

We consider the following model for sampling pairs of strings: s_1 is a ...
research
10/26/2018

Stability-certified reinforcement learning: A control-theoretic perspective

We investigate the important problem of certifying stability of reinforc...
research
11/22/2022

Safe Control and Learning Using Generalized Action Governor

This paper introduces the Generalized Action Governor, which is a superv...

Please sign up or login with your details

Forgot password? Click here to reset