The Representational Capacity of Action-Value Networks for Multi-Agent Reinforcement Learning

02/20/2019
by   Jacopo Castellini, et al.
0

Recent years have seen the application of deep reinforcement learning techniques to cooperative multi-agent systems, with great empirical success. However, given the lack of theoretical insight, it remains unclear what the employed neural networks are learning, or how we should enhance their representational power to address the problems on which they fail. In this work, we empirically investigate the representational power of various network architectures on a series of one-shot games. Despite their simplicity, these games capture many of the crucial problems that arise in the multi-agent setting, such as an exponential number of joint actions or the lack of an explicit coordination mechanism. Our results quantify how well various approaches can represent the requisite value functions, and help us identify issues that can impede good performance.

READ FULL TEXT

page 6

page 11

page 13

research
10/14/2021

HAVEN: Hierarchical Cooperative Multi-Agent Reinforcement Learning with Dual Coordination Mechanism

Multi-agent reinforcement learning often suffers from the exponentially ...
research
01/17/2020

Algorithms in Multi-Agent Systems: A Holistic Perspective from Reinforcement Learning and Game Theory

Deep reinforcement learning (RL) has achieved outstanding results in rec...
research
04/12/2021

A coevolutionary approach to deep multi-agent reinforcement learning

Traditionally, Deep Artificial Neural Networks (DNN's) are trained throu...
research
06/05/2019

Finding Friend and Foe in Multi-Agent Games

Recent breakthroughs in AI for multi-agent games like Go, Poker, and Dot...
research
01/20/2023

Multi-agent Reinforcement Learning with Graph Q-Networks for Antenna Tuning

Future generations of mobile networks are expected to contain more and m...
research
10/19/2022

Oracles Followers: Stackelberg Equilibria in Deep Multi-Agent Reinforcement Learning

Stackelberg equilibria arise naturally in a range of popular learning pr...
research
08/21/2015

Multi-agent Reinforcement Learning with Sparse Interactions by Negotiation and Knowledge Transfer

Reinforcement learning has significant applications for multi-agent syst...

Please sign up or login with your details

Forgot password? Click here to reset