Fast constraint satisfaction problem and learning-based algorithm for solving Minesweeper

05/10/2021
by   Yash Pratyush Sinha, et al.
20

Minesweeper is a popular spatial-based decision-making game that works with incomplete information. As an exemplary NP-complete problem, it is a major area of research employing various artificial intelligence paradigms. The present work models this game as Constraint Satisfaction Problem (CSP) and Markov Decision Process (MDP). We propose a new method named as dependents from the independent set using deterministic solution search (DSScsp) for the faster enumeration of all solutions of a CSP based Minesweeper game and improve the results by introducing heuristics. Using MDP, we implement machine learning methods on these heuristics. We train the classification model on sparse data with results from CSP formulation. We also propose a new rewarding method for applying a modified deep Q-learning for better accuracy and versatile learning in the Minesweeper game. The overall results have been analyzed for different kinds of Minesweeper games and their accuracies have been recorded. Results from these experiments show that the proposed method of MDP based classification model and deep Q-learning overall is the best methods in terms of accuracy for games with given mine densities.

READ FULL TEXT

page 3

page 4

page 6

page 9

page 12

page 16

page 17

page 18

research
03/02/2019

Tolling for Constraint Satisfaction in Markov Decision Process Congestion Games

Markov decision process (MDP) congestion game is an extension of classic...
research
02/16/2019

Heuristics, Answer Set Programming and Markov Decision Process for Solving a Set of Spatial Puzzles

Spatial puzzles composed of rigid objects, flexible strings and holes of...
research
07/21/2019

Online Constraint Satisfaction via Tolls in MDP Congestion Games

We consider the toll design problem that arise for a game designer of a ...
research
02/23/2018

Novel Approaches to Accelerating the Convergence Rate of Markov Decision Process for Search Result Diversification

Recently, some studies have utilized the Markov Decision Process for div...
research
04/17/2014

A Complete Solver for Constraint Games

Game Theory studies situations in which multiple agents having conflicti...
research
09/09/2019

Sensitivity Analysis for Markov Decision Process Congestion Games

We consider a non-atomic congestion game where each decision maker perfo...
research
09/30/2022

Application of Deep Q Learning with Stimulation Results for Elevator Optimization

This paper presents a methodology for combining programming and mathemat...

Please sign up or login with your details

Forgot password? Click here to reset