Flatland: a Lightweight First-Person 2-D Environment for Reinforcement Learning

09/03/2018

∙

by   Hugo Caselles-Dupré, et al.

∙

0

∙

share

We propose Flatland, a simple, lightweight environment for fast prototyping and testing of reinforcement learning agents. It is of lower complexity compared to similar 3D platforms, e.g. DeepMind Lab or VizDoom. At the same time it shares some properties with the real world, such as continuity, multi-modal partially-observable states with first-person view and coherent physics. We propose to use it as an intermediary benchmark for problems related to Lifelong Learning. Flatland is highly customizable and offers a wide range of task difficulty to extensively evaluate the properties of artificial agents. We experiment with three reinforcement learning baseline agents and show that they can rapidly solve a navigation task in Flatland. A video of an agent acting in Flatland is available here: https://youtu.be/I5y6Y2ZypdA.