An Introduction to Multi-Agent Reinforcement Learning and Review of its Application to Autonomous Mobility

03/15/2022
by   Lukas M. Schmidt, et al.
27

Many scenarios in mobility and traffic involve multiple different agents that need to cooperate to find a joint solution. Recent advances in behavioral planning use Reinforcement Learning to find effective and performant behavior strategies. However, as autonomous vehicles and vehicle-to-X communications become more mature, solutions that only utilize single, independent agents leave potential performance gains on the road. Multi-Agent Reinforcement Learning (MARL) is a research field that aims to find optimal solutions for multiple agents that interact with each other. This work aims to give an overview of the field to researchers in autonomous mobility. We first explain MARL and introduce important concepts. Then, we discuss the central paradigms that underlie MARL algorithms, and give an overview of state-of-the-art methods and ideas in each paradigm. With this background, we survey applications of MARL in autonomous mobility scenarios and give an overview of existing scenarios and implementations.

READ FULL TEXT
research
07/19/2023

Two Tales of Platoon Intelligence for Autonomous Mobility Control: Enabling Deep Learning Recipes

This paper presents the deep learning-based recent achievements to resol...
research
08/01/2021

Agent-aware State Estimation in Autonomous Vehicles

Autonomous systems often operate in environments where the behavior of m...
research
02/20/2016

Distributed Constraint Optimization Problems and Applications: A Survey

The field of Multi-Agent System (MAS) is an active area of research with...
research
04/08/2023

Shepherding Heterogeneous Flocks: Overview and Prospect

The problem of guiding a flock of several autonomous agents using repuls...
research
06/19/2019

Multi-Agent Pathfinding: Definitions, Variants, and Benchmarks

The MAPF problem is the fundamental problem of planning paths for multip...
research
02/10/2023

Scalability Bottlenecks in Multi-Agent Reinforcement Learning Systems

Multi-Agent Reinforcement Learning (MARL) is a promising area of researc...
research
12/16/2022

An Energy-aware, Fault-tolerant, and Robust Deep Reinforcement Learning based approach for Multi-agent Patrolling Problems

Autonomous vehicles are suited for continuous area patrolling problems. ...

Please sign up or login with your details

Forgot password? Click here to reset