Monte Carlo Tree Search: A Review of Recent Modifications and Applications

03/08/2021
by   Maciej Świechowski, et al.
0

Monte Carlo Tree Search (MCTS) is a powerful approach to designing game-playing bots or solving sequential decision problems. The method relies on intelligent tree search that balances exploration and exploitation. MCTS performs random sampling in the form of simulations and stores statistics of actions to make more educated choices in each subsequent iteration. The method has become a state-of-the-art technique for combinatorial games, however, in more complex games (e.g. those with high branching factor or real-time ones), as well as in various practical domains (e.g. transportation, scheduling or security) an efficient MCTS application often requires its problem-dependent modification or integration with other techniques. Such domain-specific modifications and hybrid approaches are the main focus of this survey. The last major MCTS survey has been published in 2012. Contributions that appeared since its release are of particular interest for this review.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 33

10/16/2018

MoCaNA, un agent de négociation automatique utilisant la recherche arborescente de Monte-Carlo

Automated negotiation is a rising topic in Artificial Intelligence resea...
05/14/2020

Competing in a Complex Hidden Role Game with Information Set Monte Carlo Tree Search

Advances in intelligent game playing agents have led to successes in per...
09/27/2020

Playing Carcassonne with Monte Carlo Tree Search

Monte Carlo Tree Search (MCTS) is a relatively new sampling method with ...
12/03/2013

Combining Simulated Annealing and Monte Carlo Tree Search for Expression Simplification

In many applications of computer algebra large expressions must be simpl...
03/14/2021

Monte Carlo Scene Search for 3D Scene Understanding

We explore how a general AI algorithm can be used for 3D scene understan...
03/27/2018

Accelerating Empowerment Computation with UCT Tree Search

Models of intrinsic motivation present an important means to produce sen...
02/16/2019

Re-determinizing Information Set Monte Carlo Tree Search in Hanabi

This technical report documents the winner of the Computational Intellig...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.