The Hanabi Challenge: A New Frontier for AI Research

02/01/2019
by   Nolan Bard, et al.
54

From the early days of computing, games have been important testbeds for studying how well machines can do sophisticated decision making. In recent years, machine learning has made dramatic advances with artificial agents reaching superhuman performance in challenge domains like Go, Atari, and some variants of poker. As with their predecessors of chess, checkers, and backgammon, these game domains have driven research by providing sophisticated yet well-defined challenges for artificial intelligence practitioners. We continue this tradition by proposing the game of Hanabi as a new challenge domain with novel problems that arise from its combination of purely cooperative gameplay and imperfect information in a two to five player setting. In particular, we argue that Hanabi elevates reasoning about the beliefs and intentions of other agents to the foreground. We believe developing novel techniques capable of imbuing artificial agents with such theory of mind will not only be crucial for their success in Hanabi, but also in broader collaborative efforts, and especially those with human partners. To facilitate future research, we introduce the open-source Hanabi Learning Environment, propose an experimental framework for the research community to evaluate algorithmic advances, and assess the performance of current state-of-the-art techniques.

READ FULL TEXT
research
04/26/2023

Game-based Platforms for Artificial Intelligence Research

Games have been the perfect test-beds for artificial intelligence resear...
research
06/11/2019

Survey of Artificial Intelligence for Card Games and Its Application to the Swiss Game Jass

In the last decades we have witnessed the success of applications of Art...
research
07/30/2020

Improving Multi-Agent Cooperation using Theory of Mind

Recent advances in Artificial Intelligence have produced agents that can...
research
09/16/2021

Humanly Certifying Superhuman Classifiers

Estimating the performance of a machine learning system is a longstandin...
research
09/26/2018

Towards Game-based Metrics for Computational Co-creativity

We propose the following question: what game-like interactive system wou...
research
09/01/2020

"It's Unwieldy and It Takes a Lot of Time." Challenges and Opportunities for Creating Agents in Commercial Games

Game agents such as opponents, non-player characters, and teammates are ...
research
07/22/2019

The Tools Challenge: Rapid Trial-and-Error Learning in Physical Problem Solving

Many animals, and an increasing number of artificial agents, display sop...

Please sign up or login with your details

Forgot password? Click here to reset