Alphazzle: Jigsaw Puzzle Solver with Deep Monte-Carlo Tree Search

02/01/2023
by   Marie-Morgane Paumard, et al.
0

Solving jigsaw puzzles requires to grasp the visual features of a sequence of patches and to explore efficiently a solution space that grows exponentially with the sequence length. Therefore, visual deep reinforcement learning (DRL) should answer this problem more efficiently than optimization solvers coupled with neural networks. Based on this assumption, we introduce Alphazzle, a reassembly algorithm based on single-player Monte Carlo Tree Search (MCTS). A major difference with DRL algorithms lies in the unavailability of game reward for MCTS, and we show how to estimate it from the visual input with neural networks. This constraint is induced by the puzzle-solving task and dramatically adds to the task complexity (and interest!). We perform an in-deep ablation study that shows the importance of MCTS and the neural networks working together. We achieve excellent results and get exciting insights into the combination of DRL and visual feature learning.

READ FULL TEXT

page 2

page 10

page 13

research
12/19/2020

Minimax Strikes Back

Deep Reinforcement Learning (DRL) reaches a superhuman level of play in ...
research
03/22/2018

Deep Reinforcement Learning with Model Learning and Monte Carlo Tree Search in Minecraft

Deep reinforcement learning has been successfully applied to several vis...
research
11/30/2018

Using Monte Carlo Tree Search as a Demonstrator within Asynchronous Deep RL

Deep reinforcement learning (DRL) has achieved great successes in recent...
research
01/30/2021

Deep Reinforcement Learning Aided Monte Carlo Tree Search for MIMO Detection

This paper proposes a novel multiple-input multiple-output (MIMO) symbol...
research
07/26/2021

Predicting Game Engagement and Difficulty Using AI Players

This paper presents a novel approach to automated playtesting for the pr...
research
11/22/2022

Monte Carlo Forest Search: UNSAT Solver Synthesis via Reinforcement learning

We introduce Monte Carlo Forest Search (MCFS), an offline algorithm for ...
research
11/15/2021

Generate plane quad mesh with neural networks and tree search

The quality of mesh generation has long been considered a vital aspect i...

Please sign up or login with your details

Forgot password? Click here to reset