Title: The application of improved UCT combined with neural network in Tibetan JIU chess

Authors: Yajie Wang; Kai Liang; Jilin Qiao; Yanyan Xie

Addresses: Engineering Training Centre, Shenyang Aerospace University, Shenyang City, Liaoning Province, China ' Shenyang Aerospace University, Shenyang City, Liaoning Province, China ' Shenyang Aerospace University, Shenyang City, Liaoning Province, China ' Shenyang Aerospace University, Shenyang City, Liaoning Province, China

Abstract: Tibetan JIU chess is a kind of ethnic game, which is mainly popular in Tibetan areas of China. Because of the large state space, it is impossible to use the ready-made Upper Confidence Bound Apply to Tree (UCT) game model. Given the above problem, an algorithm combining neural network and UCT is proposed. First, the strategy value function is designed to assist the simulation of UCT to prevent the inaccuracy of random simulation results. Second, the multi-process method is introduced to improve the search efficiency of the game model. Third, we simplified the structure of the neural network and improved the two-dimensional Gaussian distribution matrix to facilitate the training of the network. The experimental results demonstrate that the win rate of this reinforcement learning model has been improved, which verifies the feasibility of the proposed method.

Keywords: Tibetan JIU chess; UCT; neural network; strategy value function; multi-process.

DOI: 10.1504/IJWMC.2022.125530

International Journal of Wireless and Mobile Computing, 2022 Vol.23 No.1, pp.22 - 32

Received: 29 Sep 2021
Accepted: 14 Mar 2022
Published online: 13 Sep 2022 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article