From self-tuning regulators to reinforcement learning and back again

06/27/2019
by   Nikolai Matni, et al.
2

Machine and reinforcement learning (RL) are being applied to plan and control the behavior of autonomous systems interacting with the physical world -- examples include self-driving vehicles, distributed sensor networks, and agile robots. However, if machine learning is to be applied in these new settings, the resulting algorithms must come with the reliability, robustness, and safety guarantees that are hallmarks of the control theory literature, as failures could be catastrophic. Thus, as RL algorithms are increasingly and more aggressively deployed in safety critical settings, it is imperative that control theorists be part of the conversation. The goal of this tutorial paper is to provide a jumping off point for control theorists wishing to work on RL related problems by covering recent advances in bridging learning and control theory, and by placing these results within the appropriate historical context of the system identification and adaptive control literatures.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/15/2022

Stability Guarantees for Continuous RL Control

Lack of stability guarantees strongly limits the use of reinforcement le...
research
10/29/2022

Self-Improving Safety Performance of Reinforcement Learning Based Driving with Black-Box Verification Algorithms

In this work, we propose a self-improving artificial intelligence system...
research
02/07/2023

Adaptive Aggregation for Safety-Critical Control

Safety has been recognized as the central obstacle to preventing the use...
research
03/11/2022

Deep Binary Reinforcement Learning for Scalable Verification

The use of neural networks as function approximators has enabled many ad...
research
12/02/2021

Safe Reinforcement Learning for Grid Voltage Control

Under voltage load shedding has been considered as a standard approach t...
research
03/17/2023

Prevalence of Code Smells in Reinforcement Learning Projects

Reinforcement Learning (RL) is being increasingly used to learn and adap...
research
03/02/2023

Data-efficient, Explainable and Safe Payload Manipulation: An Illustration of the Advantages of Physical Priors in Model-Predictive Control

Machine Learning methods, such as those from the Reinforcement Learning ...

Please sign up or login with your details

Forgot password? Click here to reset