Go-Explore Complex 3D Game Environments for Automated Reachability Testing

09/01/2022
by   Cong Lu, et al.
6

Modern AAA video games feature huge game levels and maps which are increasingly hard for level testers to cover exhaustively. As a result, games often ship with catastrophic bugs such as the player falling through the floor or being stuck in walls. We propose an approach specifically targeted at reachability bugs in simulated 3D environments based on the powerful exploration algorithm, Go-Explore, which saves unique checkpoints across the map and then identifies promising ones to explore from. We show that when coupled with simple heuristics derived from the game's navigation mesh, Go-Explore finds challenging bugs and comprehensively explores complex environments without the need for human demonstration or knowledge of the game dynamics. Go-Explore vastly outperforms more complicated baselines including reinforcement learning with intrinsic curiosity in both covering the navigation mesh and number of unique positions across the map discovered. Finally, due to our use of parallel agents, our algorithm can fully cover a vast 1.5km x 1.5km game world within 10 hours on a single machine making it extremely promising for continuous testing suites.

READ FULL TEXT

page 1

page 2

page 4

page 5

research
02/25/2022

Learning to Identify Perceptual Bugs in 3D Video Games

Automated Bug Detection (ABD) in video games is composed of two distinct...
research
02/21/2022

CCPT: Automatic Gameplay Testing and Validation with Curiosity-Conditioned Proximal Trajectories

This paper proposes a novel deep reinforcement learning algorithm to per...
research
09/15/2020

Navigation and Exploration in 3D-Game Automated Play Testing

To enable automated software testing, the ability to automatically navig...
research
11/09/2020

Deep Reinforcement Learning for Navigation in AAA Video Games

In video games, non-player characters (NPCs) are used to enhance the pla...
research
03/23/2022

Learning Efficient Exploration through Human Seeded Rapidly-exploring Random Trees

Modern day computer games have extremely large state and action spaces. ...
research
07/18/2022

Inspector: Pixel-Based Automated Game Testing via Exploration, Detection, and Investigation

Deep reinforcement learning (DRL) has attracted much attention in automa...

Please sign up or login with your details

Forgot password? Click here to reset