Dungeon Crawl Stone Soup as an Evaluation Domain for Artificial Intelligence

02/05/2019
by   Dustin Dannenhauer, et al.
0

Dungeon Crawl Stone Soup is a popular, single-player, free and open-source rogue-like video game with a sufficiently complex decision space that makes it an ideal testbed for research in cognitive systems and, more generally, artificial intelligence. This paper describes the properties of Dungeon Crawl Stone Soup that are conducive to evaluating new approaches of AI systems. We also highlight an ongoing effort to build an API for AI researchers in the spirit of recent game APIs such as MALMO, ELF, and the Starcraft II API. Dungeon Crawl Stone Soup's complexity offers significant opportunities for evaluating AI and cognitive systems, including human user studies. In this paper we provide (1) a description of the state space of Dungeon Crawl Stone Soup, (2) a description of the components for our API, and (3) the potential benefits of evaluating AI agents in the Dungeon Crawl Stone Soup video game.

READ FULL TEXT
research
12/06/2016

AI Researchers, Video Games Are Your Friends!

If you are an artificial intelligence researcher, you should look to vid...
research
02/10/2019

EvalAI: Towards Better Evaluation Systems for AI Agents

We introduce EvalAI, an open source platform for evaluating and comparin...
research
12/12/2016

DeepMind Lab

DeepMind Lab is a first-person 3D game platform designed for research an...
research
07/07/2022

SC2EGSet: StarCraft II Esport Replay and Game-state Dataset

As a relatively new form of sport, esports offers unparalleled data avai...
research
01/27/2023

Polycraft World AI Lab (PAL): An Extensible Platform for Evaluating Artificial Intelligence Agents

As artificial intelligence research advances, the platforms used to eval...
research
07/17/2023

LuckyMera: a Modular AI Framework for Building Hybrid NetHack Agents

In the last few decades we have witnessed a significant development in A...
research
09/11/2020

The AIQ Meta-Testbed: Pragmatically Bridging Academic AI Testing and Industrial Q Needs

AI solutions seem to appear in any and all application domains. As AI be...

Please sign up or login with your details

Forgot password? Click here to reset