The AI Arena: A Framework for Distributed Multi-Agent Reinforcement Learning

by   Edward W. Staley, et al.

Advances in reinforcement learning (RL) have resulted in recent breakthroughs in the application of artificial intelligence (AI) across many different domains. An emerging landscape of development environments is making powerful RL techniques more accessible for a growing community of researchers. However, most existing frameworks do not directly address the problem of learning in complex operating environments, such as dense urban settings or defense-related scenarios, that incorporate distributed, heterogeneous teams of agents. To help enable AI research for this important class of applications, we introduce the AI Arena: a scalable framework with flexible abstractions for distributed multi-agent reinforcement learning. The AI Arena extends the OpenAI Gym interface to allow greater flexibility in learning control policies across multiple agents with heterogeneous learning strategies and localized views of the environment. To illustrate the utility of our framework, we present experimental results that demonstrate performance gains due to a distributed multi-agent learning approach over commonly-used RL techniques in several different learning environments.



There are no comments yet.


page 5

page 7

page 8


Mava: a research framework for distributed multi-agent reinforcement learning

Breakthrough advances in reinforcement learning (RL) research have led t...

MAgent: A Many-Agent Reinforcement Learning Platform for Artificial Collective Intelligence

We introduce MAgent, a platform to support research and development of m...

Sim-Env: Decoupling OpenAI Gym Environments from Simulation Models

Reinforcement learning (RL) is one of the most active fields of AI resea...

Network Defense is Not a Game

Research seeks to apply Artificial Intelligence (AI) to scale and extend...

Multi-agent Reinforcement Learning Embedded Game for the Optimization of Building Energy Control and Power System Planning

Most of the current game-theoretic demand-side management methods focus ...

Fiber: A Platform for Efficient Development and Distributed Training for Reinforcement Learning and Population-Based Methods

Recent advances in machine learning are consistently enabled by increasi...

Representation and Invariance in Reinforcement Learning

If we changed the rules, would the wise trade places with the fools? Dif...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.