Marathon Environments: Multi-Agent Continuous Control Benchmarks in a Modern Video Game Engine

by   Joe Booth, et al.

Recent advances in deep reinforcement learning in the paradigm of locomotion using continuous control have raised the interest of game makers for the potential of digital actors using active ragdoll. Currently, the available options to develop these ideas are either researchers' limited codebase or proprietary closed systems. We present Marathon Environments, a suite of open source, continuous control benchmarks implemented on the Unity game engine, using the Unity ML- Agents Toolkit. We demonstrate through these benchmarks that continuous control research is transferable to a commercial game engine. Furthermore, we exhibit the robustness of these environments by reproducing advanced continuous control research, such as learning to walk, run and backflip from motion capture data; learning to navigate complex terrains; and by implementing a video game input control system. We show further robustness by training with alternative algorithms found in OpenAI.Baselines. Finally, we share strategies for significantly reducing the training time.


page 3

page 4


Godot Reinforcement Learning Agents

We present Godot Reinforcement Learning (RL) Agents, an open-source inte...

DeepMind Control Suite

The DeepMind Control Suite is a set of continuous control tasks with a s...

Unity: A General Platform for Intelligent Agents

Recent advances in Deep Reinforcement Learning and Robotics have been dr...

Google Research Football: A Novel Reinforcement Learning Environment

Recent progress in the field of reinforcement learning has been accelera...

Tonic: A Deep Reinforcement Learning Library for Fast Prototyping and Benchmarking

Deep reinforcement learning has been one of the fastest growing fields o...

Procedural urban environments for FPS games

This paper presents a novel approach to procedural generation of urban m...

Realistic Physics Based Character Controller

Over the course of the last several years there was a strong interest in...