A Modular and Transferable Reinforcement Learning Framework for the Fleet Rebalancing Problem

05/27/2021
by   Erotokritos Skordilis, et al.
9

Mobility on demand (MoD) systems show great promise in realizing flexible and efficient urban transportation. However, significant technical challenges arise from operational decision making associated with MoD vehicle dispatch and fleet rebalancing. For this reason, operators tend to employ simplified algorithms that have been demonstrated to work well in a particular setting. To help bridge the gap between novel and existing methods, we propose a modular framework for fleet rebalancing based on model-free reinforcement learning (RL) that can leverage an existing dispatch method to minimize system cost. In particular, by treating dispatch as part of the environment dynamics, a centralized agent can learn to intermittently direct the dispatcher to reposition free vehicles and mitigate against fleet imbalance. We formulate RL state and action spaces as distributions over a grid partitioning of the operating area, making the framework scalable and avoiding the complexities associated with multiagent RL. Numerical experiments, using real-world trip and network data, demonstrate that this approach has several distinct advantages over baseline methods including: improved system cost; high degree of adaptability to the selected dispatch method; and the ability to perform scale-invariant transfer learning between problem instances with similar vehicle and request distributions.

READ FULL TEXT

Authors

page 1

page 8

page 9

page 13

07/27/2020

FlexPool: A Distributed Model-Free Deep Reinforcement Learning Algorithm for Joint Passengers Goods Transportation

The growth in online goods delivery is causing a dramatic surge in urban...
02/19/2020

Learning When to Transfer among Agents: An Efficient Multiagent Transfer Learning Framework

Transfer Learning has shown great potential to enhance the single-agent ...
12/01/2021

Multi-Agent Transfer Learning in Reinforcement Learning-Based Ride-Sharing Systems

Reinforcement learning (RL) has been used in a range of simulated real-w...
08/26/2021

Robust Model-based Reinforcement Learning for Autonomous Greenhouse Control

Due to the high efficiency and less weather dependency, autonomous green...
11/25/2019

End-to-End Model-Free Reinforcement Learning for Urban Driving using Implicit Affordances

Reinforcement Learning (RL) aims at learning an optimal behavior policy ...
07/12/2020

Relational-Grid-World: A Novel Relational Reasoning Environment and An Agent Model for Relational Information Extraction

Reinforcement learning (RL) agents are often designed specifically for a...
07/07/2021

Hub and Spoke Logistics Network Design for Urban Region with Clustering-Based Approach

This study aims to propose effective modeling and approach for designing...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.