DeepStack: Expert-Level Artificial Intelligence in No-Limit Poker

01/06/2017
by   Matej Moravčík, et al.
0

Artificial intelligence has seen several breakthroughs in recent years, with games often serving as milestones. A common feature of these games is that players have perfect information. Poker is the quintessential game of imperfect information, and a longstanding challenge problem in artificial intelligence. We introduce DeepStack, an algorithm for imperfect information settings. It combines recursive reasoning to handle information asymmetry, decomposition to focus computation on the relevant decision, and a form of intuition that is automatically learned from self-play using deep learning. In a study involving 44,000 hands of poker, DeepStack defeated with statistical significance professional poker players in heads-up no-limit Texas hold'em. The approach is theoretically sound and is shown to produce more difficult to exploit strategies than prior approaches.

READ FULL TEXT

page 1

page 4

page 7

page 9

research
12/06/2021

Player of Games

Games have a long history of serving as a benchmark for progress in arti...
research
02/25/2020

Very simple statistical evidence that AlphaGo has exceeded human limits in playing GO game

Deep learning technology is making great progress in solving the challen...
research
01/27/2022

DecisionHoldem: Safe Depth-Limited Solving With Diverse Opponents for Imperfect-Information Games

An imperfect-information game is a type of game with asymmetric informat...
research
07/04/2012

Bayes' Bluff: Opponent Modelling in Poker

Poker is a challenging problem for artificial intelligence, with non-det...
research
06/10/2023

Practical Problems of Statistical Learning

Statistical models have seen a significant rise in popularity in recent ...
research
09/21/2023

Quantifying Feature Importance of Games and Strategies via Shapley Values

Recent advances in game informatics have enabled us to find strong strat...
research
07/20/2020

Artificial Intelligence is stupid and causal reasoning won't fix it

Artificial Neural Networks have reached Grandmaster and even super-human...

Please sign up or login with your details

Forgot password? Click here to reset