Rolling Horizon NEAT for General Video Game Playing

05/14/2020
by   Diego Pérez-Liébana, et al.
1

This paper presents a new Statistical Forward Planning (SFP) method, Rolling Horizon NeuroEvolution of Augmenting Topologies (rhNEAT). Unlike traditional Rolling Horizon Evolution, where an evolutionary algorithm is in charge of evolving a sequence of actions, rhNEAT evolves weights and connections of a neural network in real-time, planning several steps ahead before returning an action to execute in the game. Different versions of the algorithm are explored in a collection of 20 GVGAI games, and compared with other SFP methods and state of the art results. Although results are overall not better than other SFP methods, the nature of rhNEAT to adapt to changing game features has allowed to establish new state of the art records in games that other methods have traditionally struggled with. The algorithm proposed here is general and introduces a new way of representing information within rolling horizon evolution techniques.

READ FULL TEXT
research
04/23/2017

Population Seeding Techniques for Rolling Horizon Evolution in General Video Game Playing

While Monte Carlo Tree Search and closely related methods have dominated...
research
02/14/2019

Learn a Prior for RHEA for Better Online Planning

Rolling Horizon Evolutionary Algorithms (RHEA) are a class of online pla...
research
03/27/2020

Rolling Horizon Evolutionary Algorithms for General Video Game Playing

Game-playing Evolutionary Algorithms, specifically Rolling Horizon Evolu...
research
08/30/2020

Statistical Tree-based Population Seeding for Rolling Horizon EAs in General Video Game Playing

Multiple Artificial Intelligence (AI) methods have been proposed over re...
research
10/26/2021

A Horizon Detection Algorithm for Maritime Surveillance

The horizon line is a valuable feature in the maritime environment as it...
research
04/21/2021

Portfolio Search and Optimization for General Strategy Game-Playing

Portfolio methods represent a simple but efficient type of action abstra...
research
06/01/2022

Fast and Precise: Adjusting Planning Horizon with Adaptive Subgoal Search

Complex reasoning problems contain states that vary in the computational...

Please sign up or login with your details

Forgot password? Click here to reset