Efficient Evolutionary Methods for Game Agent Optimisation: Model-Based is Best

01/03/2019
by   Simon M. Lucas, et al.
20

This paper introduces a simple and fast variant of Planet Wars as a test-bed for statistical planning based Game AI agents, and for noisy hyper-parameter optimisation. Planet Wars is a real-time strategy game with simple rules but complex game-play. The variant introduced in this paper is designed for speed to enable efficient experimentation, and also for a fixed action space to enable practical inter-operability with General Video Game AI agents. If we treat the game as a win-loss game (which is standard), then this leads to challenging noisy optimisation problems both in tuning agents to play the game, and in tuning game parameters. Here we focus on the problem of tuning an agent, and report results using the recently developed N-Tuple Bandit Evolutionary Algorithm and a number of other optimisers, including Sequential Model-based Algorithm Configuration (SMAC). Results indicate that the N-Tuple Bandit Evolutionary offers competitive performance as well as insight into the effects of combinations of parameter choices.

READ FULL TEXT
research
02/16/2018

The N-Tuple Bandit Evolutionary Algorithm for Game Agent Optimisation

This paper describes the N-Tuple Bandit Evolutionary Algorithm (NTBEA), ...
research
04/27/2020

MATE: A Model-based Algorithm Tuning Engine

In this paper, we introduce a Model-based Algorithm Turning Engine, name...
research
03/23/2020

Weighting NTBEA for Game AI Optimisation

The N-Tuple Bandit Evolutionary Algorithm (NTBEA) has proven very effect...
research
12/11/2011

Adaptive Forgetting Factor Fictitious Play

It is now well known that decentralised optimisation can be formulated a...
research
03/27/2020

Rolling Horizon Evolutionary Algorithms for General Video Game Playing

Game-playing Evolutionary Algorithms, specifically Rolling Horizon Evolu...
research
04/21/2021

Portfolio Search and Optimization for General Strategy Game-Playing

Portfolio methods represent a simple but efficient type of action abstra...
research
05/10/2021

Exploring open-ended gameplay features with Micro RollerCoaster Tycoon

This paper introduces MicroRCT, a novel open source simulator inspired b...

Please sign up or login with your details

Forgot password? Click here to reset