Event-Triggered Model Predictive Control with Deep Reinforcement Learning for Autonomous Driving

08/22/2022
by   Fengying Dang, et al.
0

Event-triggered model predictive control (eMPC) is a popular optimal control method with an aim to alleviate the computation and/or communication burden of MPC. However, it generally requires priori knowledge of the closed-loop system behavior along with the communication characteristics for designing the event-trigger policy. This paper attempts to solve this challenge by proposing an efficient eMPC framework and demonstrate successful implementation of this framework on the autonomous vehicle path following. First of all, a model-free reinforcement learning (RL) agent is used to learn the optimal event-trigger policy without the need for a complete dynamical system and communication knowledge in this framework. Furthermore, techniques including prioritized experience replay (PER) buffer and long-short term memory (LSTM) are employed to foster exploration and improve training efficiency. In this paper, we use the proposed framework with three deep RL algorithms, i.e., Double Q-learning (DDQN), Proximal Policy Optimization (PPO), and Soft Actor-Critic (SAC), to solve this problem. Experimental results show that all three deep RL-based eMPC (deep-RL-eMPC) can achieve better evaluation performance than the conventional threshold-based and previous linear Q-based approach in the autonomous path following. In particular, PPO-eMPC with LSTM and DDQN-eMPC with PER and LSTM obtains a superior balance between the closed-loop control performance and event-trigger frequency. The associated code is open-sourced and available at: https://github.com/DangFengying/RL-based-event-triggered-MPC.

READ FULL TEXT
research
10/23/2021

Policy Search using Dynamic Mirror Descent MPC for Model Free Off Policy RL

Recent works in Reinforcement Learning (RL) combine model-free (Mf)-RL a...
research
02/21/2023

UAV Path Planning Employing MPC- Reinforcement Learning Method for search and rescue mission

In this paper, we tackle the problem of Unmanned Aerial (UA V) path plan...
research
09/17/2023

Using Reinforcement Learning to Simplify Mealtime Insulin Dosing for People with Type 1 Diabetes: In-Silico Experiments

People with type 1 diabetes (T1D) struggle to calculate the optimal insu...
research
05/06/2021

A Reinforcement Learning-based Economic Model Predictive Control Framework for Autonomous Operation of Chemical Reactors

Economic model predictive control (EMPC) is a promising methodology for ...
research
12/15/2022

Driver Assistance Eco-driving and Transmission Control with Deep Reinforcement Learning

With the growing need to reduce energy consumption and greenhouse gas em...
research
10/25/2021

Recurrent Off-policy Baselines for Memory-based Continuous Control

When the environment is partially observable (PO), a deep reinforcement ...
research
04/18/2023

Safety Guaranteed Manipulation Based on Reinforcement Learning Planner and Model Predictive Control Actor

Deep reinforcement learning (RL) has been endowed with high expectations...

Please sign up or login with your details

Forgot password? Click here to reset