Hierarchical Macro Strategy Model for MOBA Game AI

12/19/2018
by   Qiang Fu, et al.
6

The next challenge of game AI lies in Real Time Strategy (RTS) games. RTS games provide partially observable gaming environments, where agents interact with one another in an action space much larger than that of GO. Mastering RTS games requires both strong macro strategies and delicate micro level execution. Recently, great progress has been made in micro level execution, while complete solutions for macro strategies are still lacking. In this paper, we propose a novel learning-based Hierarchical Macro Strategy model for mastering MOBA games, a sub-genre of RTS games. Trained by the Hierarchical Macro Strategy model, agents explicitly make macro strategy decisions and further guide their micro level execution. Moreover, each of the agents makes independent strategy decisions, while simultaneously communicating with the allies through leveraging a novel imitated cross-agent communication mechanism. We perform comprehensive evaluations on a popular 5v5 Multiplayer Online Battle Arena (MOBA) game. Our 5-AI team achieves a 48 teams which are ranked top 1

READ FULL TEXT

page 3

page 6

page 7

research
01/23/2019

Hierarchical Reinforcement Learning for Multi-agent MOBA Game

Although deep reinforcement learning has achieved great success recently...
research
10/22/2020

GAN based Unsupervised Segmentation: Should We Match the Exact Number of Objects

The unsupervised segmentation is an increasingly popular topic in biomed...
research
01/14/2019

Micro- and Macro-Level Churn Analysis of Large-Scale Mobile Games

As mobile devices become more and more popular, mobile gaming has emerge...
research
12/02/2018

Macro action selection with deep reinforcement learning in StarCraft

StarCraft (SC) is one of the most popular and successful Real Time Strat...
research
11/30/2018

Clear the Fog: Combat Value Assessment in Incomplete Information Games with Convolutional Encoder-Decoders

StarCraft, one of the most popular real-time strategy games, is a compel...
research
03/27/2018

Co-evolving Real-Time Strategy Game Micro

We investigate competitive co-evolution of unit micromanagement in real-...
research
01/20/2018

Learning model-based strategies in simple environments with hierarchical q-networks

Recent advances in deep learning have allowed artificial agents to rival...

Please sign up or login with your details

Forgot password? Click here to reset