Dynamic Bicycle Dispatching of Dockless Public Bicycle-sharing Systems using Multi-objective Reinforcement Learning

by   Jianguo Chen, et al.

As a new generation of Public Bicycle-sharing Systems (PBS), the dockless PBS (DL-PBS) is an important application of cyber-physical systems and intelligent transportation. How to use AI to provide efficient bicycle dispatching solutions based on dynamic bicycle rental demand is an essential issue for DL-PBS. In this paper, we propose a dynamic bicycle dispatching algorithm based on multi-objective reinforcement learning (MORL-BD) to provide the optimal bicycle dispatching solution for DL-PBS. We model the DL-PBS system from the perspective of CPS and use deep learning to predict the layout of bicycle parking spots and the dynamic demand of bicycle dispatching. We define the multi-route bicycle dispatching problem as a multi-objective optimization problem by considering the optimization objectives of dispatching costs, dispatch truck's initial load, workload balance among the trucks, and the dynamic balance of bicycle supply and demand. On this basis, the collaborative multi-route bicycle dispatching problem among multiple dispatch trucks is modeled as a multi-agent MORL model. All dispatch paths between parking spots are defined as state spaces, and the reciprocal of dispatching costs is defined as a reward. Each dispatch truck is equipped with an agent to learn the optimal dispatch path in the dynamic DL-PBS network. We create an elite list to store the Pareto optimal solutions of bicycle dispatch paths found in each action, and finally, get the Pareto frontier. Experimental results on the actual DL-PBS systems show that compared with existing methods, MORL-BD can find a higher quality Pareto frontier with less execution time.



There are no comments yet.


page 5

page 19


Multi-objective Conflict-based Search for Multi-agent Path Finding

Conventional multi-agent path planners typically compute an ensemble of ...

Subdimensional Expansion for Multi-objective Multi-agent Path Finding

Conventional multi-agent path planners typically determine a path that o...

Multi-condition multi-objective optimization using deep reinforcement learning

A multi-condition multi-objective optimization method that can find Pare...

Multi-Objective Optimization of the Textile Manufacturing Process Using Deep-Q-Network Based Multi-Agent Reinforcement Learning

Multi-objective optimization of the textile manufacturing process is an ...

Multi-Agent Path Finding with Deadlines: Preliminary Results

We formalize the problem of multi-agent path finding with deadlines (MAP...

Multi-Objective Reinforcement Learning based Multi-Microgrid System Optimisation Problem

Microgrids with energy storage systems and distributed renewable energy ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.