Multi-Agent Transfer Learning in Reinforcement Learning-Based Ride-Sharing Systems

12/01/2021
by   Alberto Castagna, et al.
0

Reinforcement learning (RL) has been used in a range of simulated real-world tasks, e.g., sensor coordination, traffic light control, and on-demand mobility services. However, real world deployments are rare, as RL struggles with dynamic nature of real world environments, requiring time for learning a task and adapting to changes in the environment. Transfer Learning (TL) can help lower these adaptation times. In particular, there is a significant potential of applying TL in multi-agent RL systems, where multiple agents can share knowledge with each other, as well as with new agents that join the system. To obtain the most from inter-agent transfer, transfer roles (i.e., determining which agents act as sources and which as targets), as well as relevant transfer content parameters (e.g., transfer size) should be selected dynamically in each particular situation. As a first step towards fully dynamic transfers, in this paper we investigate the impact of TL transfer parameters with fixed source and target roles. Specifically, we label every agent-environment interaction with agent's epistemic confidence, and we filter the shared examples using varying threshold levels and sample sizes. We investigate impact of these parameters in two scenarios, a standard predator-prey RL benchmark and a simulation of a ride-sharing system with 200 vehicle agents and 10,000 ride-requests.

READ FULL TEXT
research
03/02/2023

Expert-Free Online Transfer Learning in Multi-Agent Reinforcement Learning

Transfer learning in Reinforcement Learning (RL) has been widely studied...
research
05/22/2023

Adaptive action supervision in reinforcement learning from real-world multi-agent demonstrations

Modeling of real-world biological multi-agents is a fundamental problem ...
research
10/09/2018

A Distributed Reinforcement Learning Solution With Knowledge Transfer Capability for A Bike Rebalancing Problem

Rebalancing is a critical service bottleneck for many transportation ser...
research
10/29/2021

Learning to Communicate with Reinforcement Learning for an Adaptive Traffic Control System

Recent work in multi-agent reinforcement learning has investigated inter...
research
05/24/2021

Room Clearance with Feudal Hierarchical Reinforcement Learning

Reinforcement learning (RL) is a general framework that allows systems t...
research
04/29/2023

Learning to Seek: Multi-Agent Online Source Seeking Against Non-Stochastic Disturbances

This paper proposes to leverage the emerging learning techniques and dev...
research
05/27/2021

A Modular and Transferable Reinforcement Learning Framework for the Fleet Rebalancing Problem

Mobility on demand (MoD) systems show great promise in realizing flexibl...

Please sign up or login with your details

Forgot password? Click here to reset