Graph augmented Deep Reinforcement Learning in the GameRLand3D environment

12/22/2021
by   Edward Beeching, et al.
11

We address planning and navigation in challenging 3D video games featuring maps with disconnected regions reachable by agents using special actions. In this setting, classical symbolic planners are not applicable or difficult to adapt. We introduce a hybrid technique combining a low level policy trained with reinforcement learning and a graph based high level classical planner. In addition to providing human-interpretable paths, the approach improves the generalization performance of an end-to-end approach in unseen maps, where it achieves a 20 agent on a point to point navigation task in yet unseen large-scale maps of size 1km x 1km. In an in-depth experimental study, we quantify the limitations of end-to-end Deep RL approaches in vast environments and we also introduce "GameRLand3D", a new benchmark and soon to be released environment can generate complex procedural 3D maps for navigation tasks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/17/2022

Comparison of Model-Free and Model-Based Learning-Informed Planning for PointGoal Navigation

In recent years several learning approaches to point goal navigation in ...
research
11/09/2020

Deep Reinforcement Learning for Navigation in AAA Video Games

In video games, non-player characters (NPCs) are used to enhance the pla...
research
06/27/2021

Continuous Control with Deep Reinforcement Learning for Autonomous Vessels

Maritime autonomous transportation has played a crucial role in the glob...
research
07/20/2020

Seeing the Un-Scene: Learning Amodal Semantic Maps for Room Navigation

We introduce a learning-based approach for room navigation using semanti...
research
01/06/2023

ReVoLT: Relational Reasoning and Voronoi Local Graph Planning for Target-driven Navigation

Embodied AI is an inevitable trend that emphasizes the interaction betwe...
research
07/10/2020

Learning to plan with uncertain topological maps

We train an agent to navigate in 3D environments using a hierarchical st...
research
12/31/2018

From Pixels to Buildings: End-to-end Probabilistic Deep Networks for Large-scale Semantic Mapping

We introduce TopoNets, end-to-end probabilistic deep networks for modeli...

Please sign up or login with your details

Forgot password? Click here to reset