Federated Reinforcement Learning for Real-Time Electric Vehicle Charging and Discharging Control

10/04/2022

∙

With the recent advances in mobile energy storage technologies, electric vehicles (EVs) have become a crucial part of smart grids. When EVs participate in the demand response program, the charging cost can be significantly reduced by taking full advantage of the real-time pricing signals. However, many stochastic factors exist in the dynamic environment, bringing significant challenges to design an optimal charging/discharging control strategy. This paper develops an optimal EV charging/discharging control strategy for different EV users under dynamic environments to maximize EV users' benefits. We first formulate this problem as a Markov decision process (MDP). Then we consider EV users with different behaviors as agents in different environments. Furthermore, a horizontal federated reinforcement learning (HFRL)-based method is proposed to fit various users' behaviors and dynamic environments. This approach can learn an optimal charging/discharging control strategy without sharing users' profiles. Simulation results illustrate that the proposed real-time EV charging/discharging control strategy can perform well among various stochastic factors.

READ FULL TEXT

Federated Reinforcement Learning for Real-Time Electric Vehicle Charging and Discharging Control

Eco-driving for Electric Connected Vehicles at Signalized Intersections: A Parameterized Reinforcement Learning approach

Learning the policy for mixed electric platoon control of automated and human-driven vehicles at signalized intersection: a random search approach

Arbitrage of Energy Storage in Electricity Markets with Deep Reinforcement Learning

Learning Time Reduction Using Warm Start Methods for a Reinforcement Learning Based Supervisory Control in Hybrid Electric Vehicle Applications

Spatio-temporal Incentives Optimization for Ride-hailing Services with Offline Deep Reinforcement Learning

A Data-driven Storage Control Framework for Dynamic Pricing

Computationally efficient joint coordination of multiple electric vehicle charging points using reinforcement learning

Federated Reinforcement Learning for Real-Time Electric Vehicle Charging and Discharging Control

Related Research

Eco-driving for Electric Connected Vehicles at Signalized Intersections: A Parameterized Reinforcement Learning approach

Learning the policy for mixed electric platoon control of automated and human-driven vehicles at signalized intersection: a random search approach

Arbitrage of Energy Storage in Electricity Markets with Deep Reinforcement Learning

Learning Time Reduction Using Warm Start Methods for a Reinforcement Learning Based Supervisory Control in Hybrid Electric Vehicle Applications

Spatio-temporal Incentives Optimization for Ride-hailing Services with Offline Deep Reinforcement Learning

A Data-driven Storage Control Framework for Dynamic Pricing

Computationally efficient joint coordination of multiple electric vehicle charging points using reinforcement learning