Multi-Labelled Value Networks for Computer Go

05/30/2017
by   Ti-Rong Wu, et al.
1

This paper proposes a new approach to a novel value network architecture for the game Go, called a multi-labelled (ML) value network. In the ML value network, different values (win rates) are trained simultaneously for different settings of komi, a compensation given to balance the initiative of playing first. The ML value network has three advantages, (a) it outputs values for different komi, (b) it supports dynamic komi, and (c) it lowers the mean squared error (MSE). This paper also proposes a new dynamic komi method to improve game-playing strength. This paper also performs experiments to demonstrate the merits of the architecture. First, the MSE of the ML value network is generally lower than the value network alone. Second, the program based on the ML value network wins by a rate of 67.6 on the value network alone. Third, the program with the proposed dynamic komi method significantly improves the playing strength over the baseline that does not use dynamic komi, especially for handicap games. To our knowledge, up to date, no handicap games have been played openly by programs using value networks. This paper provides these programs with a useful approach to playing handicap games.

READ FULL TEXT

page 4

page 7

page 12

research
08/23/2020

Mobile Networks for Computer Go

The architecture of the neural networks used in Deep Reinforcement Learn...
research
06/10/2020

Rinascimento: using event-value functions for playing Splendor

In the realm of games research, Artificial General Intelligence algorith...
research
03/21/2019

Biasing MCTS with Features for General Games

This paper proposes using a linear function approximator, rather than a ...
research
08/05/2022

Learning programs with magic values

A magic value in a program is a constant symbol that is essential for th...
research
03/19/2019

Hyper-Parameter Sweep on AlphaZero General

Since AlphaGo and AlphaGo Zero have achieved breakground successes in th...
research
06/05/2019

Building a Computer Mahjong Player via Deep Convolutional Neural Networks

The evaluation function for imperfect information games is always hard t...
research
07/27/2016

Automatically Reinforcing a Game AI

A recent research trend in Artificial Intelligence (AI) is the combinati...

Please sign up or login with your details

Forgot password? Click here to reset