Learning Event-triggered Control from Data through Joint Optimization

08/11/2020
by   Niklas Funk, et al.
0

We present a framework for model-free learning of event-triggered control strategies. Event-triggered methods aim to achieve high control performance while only closing the feedback loop when needed. This enables resource savings, e.g., network bandwidth if control commands are sent via communication networks, as in networked control systems. Event-triggered controllers consist of a communication policy, determining when to communicate, and a control policy, deciding what to communicate. It is essential to jointly optimize the two policies since individual optimization does not necessarily yield the overall optimal solution. To address this need for joint optimization, we propose a novel algorithm based on hierarchical reinforcement learning. The resulting algorithm is shown to accomplish high-performance control in line with resource savings and scales seamlessly to nonlinear and high-dimensional systems. The method's applicability to real-world scenarios is demonstrated through experiments on a six degrees of freedom real-time controlled manipulator. Further, we propose an approach towards evaluating the stability of the learned neural network policies.

READ FULL TEXT
05/14/2022

A Learning Approach for Joint Design of Event-triggered Control and Power-Efficient Resource Allocation

In emerging Industrial Cyber-Physical Systems (ICPSs), the joint design ...
05/24/2022

Learning Stabilizing Policies in Stochastic Control Systems

In this work, we address the problem of learning provably stable neural ...
05/23/2017

Safe Model-based Reinforcement Learning with Stability Guarantees

Reinforcement learning is a powerful paradigm for learning optimal polic...
09/17/2018

Policy Optimization via Importance Sampling

Policy optimization is an effective reinforcement learning approach to s...
08/22/2022

Event-Triggered Model Predictive Control with Deep Reinforcement Learning for Autonomous Driving

Event-triggered model predictive control (eMPC) is a popular optimal con...
08/05/2021

Online Model-Free Reinforcement Learning for the Automatic Control of a Flexible Wing Aircraft

The control problem of the flexible wing aircraft is challenging due to ...
05/02/2021

Feedback control of event cameras

Dynamic vision sensor event cameras produce a variable data rate stream ...