An Overview of Multi-Agent Reinforcement Learning from Game Theoretical Perspective

11/01/2020
by   Yaodong Yang, et al.
89

Following the remarkable success of the AlphaGO series, 2019 was a booming year that witnessed significant advances in multi-agent reinforcement learning (MARL) techniques. MARL corresponds to the learning problem in a multi-agent system in which multiple agents learn simultaneously. It is an interdisciplinary domain with a long history that includes game theory, machine learning, stochastic control, psychology, and optimisation. Although MARL has achieved considerable empirical success in solving real-world games, there is a lack of a self-contained overview in the literature that elaborates the game theoretical foundations of modern MARL methods and summarises the recent advances. In fact, the majority of existing surveys are outdated and do not fully cover the recent developments since 2010. In this work, we provide a monograph on MARL that covers both the fundamentals and the latest developments in the research frontier. The goal of our monograph is to provide a self-contained assessment of the current state-of-the-art MARL techniques from a game theoretical perspective. We expect this work to serve as a stepping stone for both new researchers who are about to enter this fast-growing domain and existing domain experts who want to obtain a panoramic view and identify new directions based on recent advances.

READ FULL TEXT

page 5

page 8

page 21

page 22

11/24/2019

Multi-Agent Reinforcement Learning: A Selective Overview of Theories and Algorithms

Recent years have witnessed significant advances in reinforcement learni...
12/01/2019

Optimization for Reinforcement Learning: From Single Agent to Cooperative Agents

This article reviews recent advances in multi-agent reinforcement learni...
12/09/2019

Decentralized Multi-Agent Reinforcement Learning with Networked Agents: Recent Advances

Multi-agent reinforcement learning (MARL) has long been a significant an...
05/17/2021

The Confluence of Networks, Games and Learning

Recent years have witnessed significant advances in technologies and ser...
03/15/2022

An Introduction to Multi-Agent Reinforcement Learning and Review of its Application to Autonomous Mobility

Many scenarios in mobility and traffic involve multiple different agents...
03/14/2022

Calibration of Derivative Pricing Models: a Multi-Agent Reinforcement Learning Perspective

One of the most fundamental questions in quantitative finance is the exi...

Code Repositories