DeepAI AI Chat
Log In Sign Up

Mastering Strategy Card Game (Hearthstone) with Improved Techniques

by   Changnan Xiao, et al.
ByteDance Inc.

Strategy card game is a well-known genre that is demanding on the intelligent game-play and can be an ideal test-bench for AI. Previous work combines an end-to-end policy function and an optimistic smooth fictitious play, which shows promising performances on the strategy card game Legend of Code and Magic. In this work, we apply such algorithms to Hearthstone, a famous commercial game that is more complicated in game rules and mechanisms. We further propose several improved techniques and consequently achieve significant progress. For a machine-vs-human test we invite a Hearthstone streamer whose best rank was top 10 of the official league in China region that is estimated to be of millions of players. Our models defeat the human player in all Best-of-5 tournaments of full games (including both deck building and battle), showing a strong capability of decision making.


Mastering Strategy Card Game (Legends of Code and Magic) via End-to-End Policy and Optimistic Smooth Fictitious Play

Deep Reinforcement Learning combined with Fictitious Play shows impressi...

Mastering Terra Mystica: Applying Self-Play to Multi-agent Cooperative Board Games

In this paper, we explore and compare multiple algorithms for solving th...

Evolving Evaluation Functions for Collectible Card Game AI

In this work, we presented a study regarding two important aspects of ev...

Inducing game rules from varying quality game play

General Game Playing (GGP) is a framework in which an artificial intelli...

Developing Parallel Dependency Graph In Improving Game Balancing

The dependency graph is a data architecture that models all the dependen...

On the complexity of Dark Chinese Chess

This paper provides a complexity analysis for the game of dark Chinese c...

Analysis of Evolutionary Program Synthesis for Card Games

In this report, we inspect the application of an evolutionary approach t...