Intelligent Electric Vehicle Charging Recommendation Based on Multi-Agent Reinforcement Learning

02/15/2021
by   Weijia Zhang, et al.
0

Electric Vehicle (EV) has become a preferable choice in the modern transportation system due to its environmental and energy sustainability. However, in many large cities, EV drivers often fail to find the proper spots for charging, because of the limited charging infrastructures and the spatiotemporally unbalanced charging demands. Indeed, the recent emergence of deep reinforcement learning provides great potential to improve the charging experience from various aspects over a long-term horizon. In this paper, we propose a framework, named Multi-Agent Spatio-Temporal Reinforcement Learning (Master), for intelligently recommending public accessible charging stations by jointly considering various long-term spatiotemporal factors. Specifically, by regarding each charging station as an individual agent, we formulate this problem as a multi-objective multi-agent reinforcement learning task. We first develop a multi-agent actor-critic framework with the centralized attentive critic to coordinate the recommendation between geo-distributed agents. Moreover, to quantify the influence of future potential charging competition, we introduce a delayed access strategy to exploit the knowledge of future charging competition during training. After that, to effectively optimize multiple learning objectives, we extend the centralized attentive critic to multi-critics and develop a dynamic gradient re-weighting strategy to adaptively guide the optimization direction. Finally, extensive experiments on two real-world datasets demonstrate that Master achieves the best comprehensive performance compared with nine baseline approaches.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/08/2019

Hierarchical Critics Assignment for Multi-agent Reinforcement Learning

In this paper, we investigate the use of global information to speed up ...
research
02/17/2019

Optimizing Online Matching for Ride-Sourcing Services with Multi-Agent Deep Reinforcement Learning

Ride-sourcing services are now reshaping the way people travel by effect...
research
02/08/2021

Contrasting Centralized and Decentralized Critics in Multi-Agent Reinforcement Learning

Centralized Training for Decentralized Execution, where agents are train...
research
10/02/2021

AB-Mapper: Attention and BicNet Based Multi-agent Path Finding for Dynamic Crowded Environment

Multi-agent path finding in dynamic crowded environments is of great aca...
research
05/12/2023

Multi-Agent Reinforcement Learning for Network Routing in Integrated Access Backhaul Networks

We investigate the problem of wireless routing in integrated access back...
research
08/27/2023

MARL for Decentralized Electric Vehicle Charging Coordination with V2V Energy Exchange

Effective energy management of electric vehicle (EV) charging stations i...
research
05/27/2019

CoRide: Joint Order Dispatching and Fleet Management for Multi-Scale Ride-Hailing Platforms

How to optimally dispatch orders to vehicles and how to trade off betwee...

Please sign up or login with your details

Forgot password? Click here to reset