Learning to Play Othello with Deep Neural Networks

11/17/2017
by   Paweł Liskowski, et al.
0

Achieving superhuman playing level by AlphaGo corroborated the capabilities of convolutional neural architectures (CNNs) for capturing complex spatial patterns. This result was to a great extent due to several analogies between Go board states and 2D images CNNs have been designed for, in particular translational invariance and a relatively large board. In this paper, we verify whether CNN-based move predictors prove effective for Othello, a game with significantly different characteristics, including a much smaller board size and complete lack of translational invariance. We compare several CNN architectures and board encodings, augment them with state-of-the-art extensions, train on an extensive database of experts' moves, and examine them with respect to move prediction accuracy and playing strength. The empirical evaluation confirms high capabilities of neural move predictors and suggests a strong correlation between prediction accuracy and playing strength. The best CNNs not only surpass all other 1-ply Othello players proposed to date but defeat (2-ply) Edax, the best open-source Othello player.

READ FULL TEXT

page 3

page 6

research
07/18/2021

Train on Small, Play the Large: Scaling Up Board Games with AlphaZero and GNN

Playing board games is considered a major challenge for both humans and ...
research
03/08/2022

Logic-based AI for Interpretable Board Game Winner Prediction with Tsetlin Machine

Hex is a turn-based two-player connection game with a high branching fac...
research
01/17/2022

Spatial State-Action Features for General Games

In many board games and other abstract games, patterns have been used as...
research
11/30/2006

On Measuring the Impact of Human Actions in the Machine Learning of a Board Game's Playing Policies

We investigate systematically the impact of human intervention in the tr...
research
06/05/2014

Systematic N-tuple Networks for Position Evaluation: Exceeding 90 the Othello League

N-tuple networks have been successfully used as position evaluation func...
research
09/24/2012

On Move Pattern Trends in a Large Go Games Corpus

We process a large corpus of game records of the board game of Go and pr...
research
01/31/2022

Leela Zero Score: a Study of a Score-based AlphaGo Zero

AlphaGo, AlphaGo Zero, and all of their derivatives can play with superh...

Please sign up or login with your details

Forgot password? Click here to reset