CCPT: Automatic Gameplay Testing and Validation with Curiosity-Conditioned Proximal Trajectories

02/21/2022
by   Alessandro Sestini, et al.
2

This paper proposes a novel deep reinforcement learning algorithm to perform automatic analysis and detection of gameplay issues in complex 3D navigation environments. The Curiosity-Conditioned Proximal Trajectories (CCPT) method combines curiosity and imitation learning to train agents to methodically explore in the proximity of known trajectories derived from expert demonstrations. We show how CCPT can explore complex environments, discover gameplay issues and design oversights in the process, and recognize and highlight them directly to game designers. We further demonstrate the effectiveness of the algorithm in a novel 3D navigation environment which reflects the complexity of modern AAA video games. Our results show a higher level of coverage and bug discovery than baselines methods, and it hence can provide a valuable tool for game designers to identify issues in game design automatically.

READ FULL TEXT

page 3

page 6

page 10

page 11

research
09/01/2022

Go-Explore Complex 3D Game Environments for Automated Reachability Testing

Modern AAA video games feature huge game levels and maps which are incre...
research
03/25/2021

Improving Playtesting Coverage via Curiosity Driven Reinforcement Learning Agents

As modern games continue growing both in size and complexity, it has bec...
research
08/18/2023

Preference-conditioned Pixel-based AI Agent For Game Testing

The game industry is challenged to cope with increasing growth in demand...
research
08/15/2022

Towards Informed Design and Validation Assistance in Computer Games Using Imitation Learning

In games, as in and many other domains, design validation and testing is...
research
11/09/2020

Deep Reinforcement Learning for Navigation in AAA Video Games

In video games, non-player characters (NPCs) are used to enhance the pla...
research
01/30/2023

Hierarchical Imitation Learning with Vector Quantized Models

The ability to plan actions on multiple levels of abstraction enables in...
research
07/03/2020

Strategies for Using Proximal Policy Optimization in Mobile Puzzle Games

While traditionally a labour intensive task, the testing of game content...

Please sign up or login with your details

Forgot password? Click here to reset