Model-Based Stochastic Search for Large Scale Optimization of Multi-Agent UAV Swarms

03/03/2018
by   David D. Fan, et al.
0

Recent work from the reinforcement learning community has shown that Evolution Strategies are a fast and scalable alternative to other reinforcement learning methods. In this paper we show that Evolution Strategies are a special case of model-based stochastic search methods. This class of algorithms has nice asymptotic convergence properties and known convergence rates. We show how these methods can be used to solve both cooperative and competitive multi-agent problems in an efficient manner. We demonstrate the effectiveness of this approach on two complex multi-agent UAV swarm combat scenarios: where a team of fixed wing aircraft must attack a well-defended base, and where two teams of agents go head to head to defeat each other.

READ FULL TEXT

page 1

page 5

page 6

research
07/06/2020

Natural Emergence of Heterogeneous Strategies in Artificially Intelligent Competitive Teams

Multi agent strategies in mixed cooperative-competitive environments can...
research
12/01/2019

Optimization for Reinforcement Learning: From Single Agent to Cooperative Agents

This article reviews recent advances in multi-agent reinforcement learni...
research
02/07/2022

Evaluating Robustness of Cooperative MARL: A Model-based Approach

In recent years, a proliferation of methods were developed for cooperati...
research
01/29/2019

Multi Agent Reinforcement Learning with Multi-Step Generative Models

The dynamics between agents and the environment are an important compone...
research
11/08/2022

Policy-Based Reinforcement Learning for Assortative Matching in Human Behavior Modeling

This paper explores human behavior in virtual networked communities, spe...
research
06/01/2023

Chaos persists in large-scale multi-agent learning despite adaptive learning rates

Multi-agent learning is intrinsically harder, more unstable and unpredic...
research
06/18/2023

Evolving Strategies for Competitive Multi-Agent Search

While evolutionary computation is well suited for automatic discovery in...

Please sign up or login with your details

Forgot password? Click here to reset