A Modular and Transferable Reinforcement Learning Framework for the Fleet Rebalancing Problem

05/27/2021
by   Erotokritos Skordilis, et al.
9

Mobility on demand (MoD) systems show great promise in realizing flexible and efficient urban transportation. However, significant technical challenges arise from operational decision making associated with MoD vehicle dispatch and fleet rebalancing. For this reason, operators tend to employ simplified algorithms that have been demonstrated to work well in a particular setting. To help bridge the gap between novel and existing methods, we propose a modular framework for fleet rebalancing based on model-free reinforcement learning (RL) that can leverage an existing dispatch method to minimize system cost. In particular, by treating dispatch as part of the environment dynamics, a centralized agent can learn to intermittently direct the dispatcher to reposition free vehicles and mitigate against fleet imbalance. We formulate RL state and action spaces as distributions over a grid partitioning of the operating area, making the framework scalable and avoiding the complexities associated with multiagent RL. Numerical experiments, using real-world trip and network data, demonstrate that this approach has several distinct advantages over baseline methods including: improved system cost; high degree of adaptability to the selected dispatch method; and the ability to perform scale-invariant transfer learning between problem instances with similar vehicle and request distributions.

READ FULL TEXT

page 1

page 8

page 9

page 13

research
07/27/2020

FlexPool: A Distributed Model-Free Deep Reinforcement Learning Algorithm for Joint Passengers Goods Transportation

The growth in online goods delivery is causing a dramatic surge in urban...
research
04/26/2023

Reinforcement Learning with Partial Parametric Model Knowledge

We adapt reinforcement learning (RL) methods for continuous control to b...
research
02/19/2020

Learning When to Transfer among Agents: An Efficient Multiagent Transfer Learning Framework

Transfer Learning has shown great potential to enhance the single-agent ...
research
02/28/2023

Learning to Control Autonomous Fleets from Observation via Offline Reinforcement Learning

Autonomous Mobility-on-Demand (AMoD) systems are a rapidly evolving mode...
research
12/01/2021

Multi-Agent Transfer Learning in Reinforcement Learning-Based Ride-Sharing Systems

Reinforcement learning (RL) has been used in a range of simulated real-w...
research
12/12/2022

Reinforcement Learning and Tree Search Methods for the Unit Commitment Problem

The unit commitment (UC) problem, which determines operating schedules o...
research
02/12/2023

Graph Learning Based Decision Support for Multi-Aircraft Take-Off and Landing at Urban Air Mobility Vertiports

Majority of aircraft under the Urban Air Mobility (UAM) concept are expe...

Please sign up or login with your details

Forgot password? Click here to reset