Learning Time Reduction Using Warm Start Methods for a Reinforcement Learning Based Supervisory Control in Hybrid Electric Vehicle Applications

by   Bin Xu, et al.

Reinforcement Learning (RL) is widely utilized in the field of robotics, and as such, it is gradually being implemented in the Hybrid Electric Vehicle (HEV) supervisory control. Even though RL exhibits excellent performance in terms of fuel consumption minimization in simulation, the large learning iteration number needs a long learning time, making it hardly applicable in real-world vehicles. In addition, the fuel consumption of initial learning phases is much worse than baseline controls. This study aims to reduce the learning iterations of Q-learning in HEV application and improve fuel consumption in initial learning phases utilizing warm start methods. Different from previous studies, which initiated Q-learning with zero or random Q values, this study initiates the Q-learning with different supervisory controls (i.e., Equivalent Consumption Minimization Strategy control and heuristic control), and detailed analysis is given. The results show that the proposed warm start Q-learning requires 68.8 Q-learning is validated in two different driving cycles, and the results show 10-16 Strategy control. Furthermore, real-time feasibility is analyzed, and the guidance of vehicle implementation is provided. The results of this study can be used to facilitate the deployment of RL in vehicle supervisory control applications.



There are no comments yet.


page 1

page 8

page 14

page 15

page 16

page 19

page 23


Data-Driven Transferred Energy Management Strategy for Hybrid Electric Vehicles via Deep Reinforcement Learning

Real-time applications of energy management strategies (EMSs) in hybrid ...

Adaptive Energy Management for Real Driving Conditions via Transfer Reinforcement Learning

This article proposes a transfer reinforcement learning (RL) based adapt...

Learning Eco-Driving Strategies at Signalized Intersections

Signalized intersections in arterial roads result in persistent vehicle ...

A Physics Model-Guided Online Bayesian Framework for Energy Management of Extended Range Electric Delivery Vehicles

Increasing the fuel economy of hybrid electric vehicles (HEVs) and exten...

Safe Model-based Off-policy Reinforcement Learning for Eco-Driving in Connected and Automated Hybrid Electric Vehicles

Connected and Automated Hybrid Electric Vehicles have the potential to r...

Computationally efficient joint coordination of multiple electric vehicle charging points using reinforcement learning

A major challenge in todays power grid is to manage the increasing load ...

Transferred Energy Management Strategies for Hybrid Electric Vehicles Based on Driving Conditions Recognition

Energy management strategies (EMSs) are the most significant components ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.