DecisionHoldem: Safe Depth-Limited Solving With Diverse Opponents for Imperfect-Information Games

01/27/2022
by   Qibin Zhou, et al.
0

An imperfect-information game is a type of game with asymmetric information. It is more common in life than perfect-information game. Artificial intelligence (AI) in imperfect-information games, such like poker, has made considerable progress and success in recent years. The great success of superhuman poker AI, such as Libratus and Deepstack, attracts researchers to pay attention to poker research. However, the lack of open-source code limits the development of Texas hold'em AI to some extent. This article introduces DecisionHoldem, a high-level AI for heads-up no-limit Texas hold'em with safe depth-limited subgame solving by considering possible ranges of opponent's private hands to reduce the exploitability of the strategy. Experimental results show that DecisionHoldem defeats the strongest openly available agent in heads-up no-limit Texas hold'em poker, namely Slumbot, and a high-level reproduction of Deepstack, viz, Openstack, by more than 730 mbb/h (one-thousandth big blind per round) and 700 mbb/h. Moreover, we release the source codes and tools of DecisionHoldem to promote AI development in imperfect-information games.

READ FULL TEXT
research
05/21/2018

Depth-Limited Solving for Imperfect-Information Games

A fundamental challenge in imperfect-information games is that states do...
research
03/30/2020

Suphx: Mastering Mahjong with Deep Reinforcement Learning

Artificial Intelligence (AI) has achieved great success in many domains,...
research
05/08/2017

Safe and Nested Subgame Solving for Imperfect-Information Games

In imperfect-information games, the optimal strategy in a subgame may de...
research
12/11/2020

OpenHoldem: An Open Toolkit for Large-Scale Imperfect-Information Game Research

Owning to the unremitting efforts by a few institutes, significant progr...
research
01/06/2017

DeepStack: Expert-Level Artificial Intelligence in No-Limit Poker

Artificial intelligence has seen several breakthroughs in recent years, ...
research
06/26/2023

Experiments with Detecting and Mitigating AI Deception

How to detect and mitigate deceptive AI systems is an open problem for t...
research
06/10/2021

Subgame solving without common knowledge

In imperfect-information games, subgame solving is significantly more ch...

Please sign up or login with your details

Forgot password? Click here to reset