Player of Games

12/06/2021
by   Martin Schmid, et al.
0

Games have a long history of serving as a benchmark for progress in artificial intelligence. Recently, approaches using search and learning have shown strong performance across a set of perfect information games, and approaches using game-theoretic reasoning and learning have shown strong performance for specific imperfect information poker variants. We introduce Player of Games, a general-purpose algorithm that unifies previous approaches, combining guided search, self-play learning, and game-theoretic reasoning. Player of Games is the first algorithm to achieve strong empirical performance in large perfect and imperfect information games – an important step towards truly general algorithms for arbitrary environments. We prove that Player of Games is sound, converging to perfect play as available computation time and approximation capacity increases. Player of Games reaches strong performance in chess and Go, beats the strongest openly available agent in heads-up no-limit Texas hold'em poker (Slumbot), and defeats the state-of-the-art agent in Scotland Yard, an imperfect information game that illustrates the value of guided search, learning, and game-theoretic reasoning.

READ FULL TEXT

page 21

page 30

research
07/27/2020

Combining Deep Reinforcement Learning and Search for Imperfect-Information Games

The combination of deep reinforcement learning and search at both traini...
research
01/06/2017

DeepStack: Expert-Level Artificial Intelligence in No-Limit Poker

Artificial intelligence has seen several breakthroughs in recent years, ...
research
11/10/2021

Search in Imperfect Information Games

From the very dawn of the field, search with value functions was a funda...
research
03/30/2022

PerfectDou: Dominating DouDizhu with Perfect Information Distillation

As a challenging multi-player card game, DouDizhu has recently drawn muc...
research
05/27/2022

Improving Bidding and Playing Strategies in the Trick-Taking game Wizard using Deep Q-Networks

In this work, the trick-taking game Wizard with a separate bidding and p...
research
02/08/2023

Learning to Play Stochastic Two-player Perfect-Information Games without Knowledge

In this paper, we extend the Descent framework, which enables learning a...
research
05/14/2021

Translating Extensive Form Games to Open Games with Agency

We show open games cover extensive form games with both perfect and impe...

Please sign up or login with your details

Forgot password? Click here to reset