Move evaluation in go using deep convolutional neural networks

3rd International Conference on Learning Representations, ICLR 2015 - Conference Track Proceedings

Volumn , Issue , 2015, Pages

  Maddison, Chris J ^a   Huang, Aja ^b   Sutskever, Ilya ^c   Silver, David ^b  

^a UNIVERSITY OF TORONTO   (Canada)

^b DEEPMIND   (United Kingdom)

^c GOOGLE INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONVOLUTION; NEURAL NETWORKS;

BOARD GAMES; CONVOLUTIONAL NETWORKS; CONVOLUTIONAL NEURAL NETWORK; EVALUATION FUNCTION; HUMAN PLAYERS; MONTE-CARLO TREE SEARCHES; STATE OF THE ART;

DEEP NEURAL NETWORKS;

EID: 85083951314     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (18)

1. Baudiš, Petr and Gailly, Jean-loup. Pachi: State of the art open source go program. In Advances in Computer Games, pp. 24–38. Springer, 2012.
2. Chaslot, Guillaume M. J-B., Winands, Mark H. M., van den Herik, H. Jaap, Uiterwijk, Jos W. H. M., and Bouzy, Bruno. Progressive strategies for Monte-Carlo tree search. New Mathematics and Natural Computation, 4:343–357, 2008. doi: 10.1142/S1793005708001094.
3. Clark, Christopher and Storkey, Amos. Teaching deep convolutional neural networks to play Go. arXiv preprint arXiv:1412.3409, 2014.
4. Coulom, Rémi. Efficient selectivity and backup operators in Monte-Carlo tree search. In Computers and games, pp. 72–83. Springer, 2007.
5. Dean, Jeffrey, Corrado, Greg, Monga, Rajat, Chen, Kai, Devin, Matthieu, Mao, Mark, aurelio Ranzato, Marc’, Senior, Andrew, Tucker, Paul, Yang, Ke, Le, Quoc V., and Ng, Andrew Y. Large scale distributed deep networks. In Pereira, F., Burges, C.J.C., Bottou, L., and Weinberger, K.Q. (eds.), Advances in Neural Information Processing Systems 25, pp. 1223–1231. Curran Associates, Inc., 2012. URL http://papers.nips.cc/paper/4687-large-scale-distributed-deep-networks.pdf.
6. Enzenberger, Markus. The integration of a priori knowledge into a Go playing neural network. URL: http://www. markus-enzenberger. de/neurogo. html, 1996.
7. Enzenberger, Markus, Müller, Martin, Arneson, Broderick, and Segal, R. Fuego - an open-source framework for board games and Go engine based on monte carlo tree search. IEEE Trans. Comput. Intellig. and AI in Games, 2(4):259–270, 2010.
8. Gelly, S. and Silver, D. Combining online and offline learning in UCT. In 17th International Conference on Machine Learning, pp. 273–280, 2007.
9. Gelly, S. and Silver, D. Monte-Carlo tree search and rapid action value estimation in computer Go. Artificial Intelligence, 175:1856–1875, 2011.
10. Huang, Shih-Chieh and Müller, Martin. Investigating the limits of Monte-Carlo tree search methods in computer Go. In Computers and Games - 8th International Conference, CG 2013, Yokohama, Japan, August 13-15, 2013, Revised Selected Papers, pp. 39–48, 2013.
11. Huang, Shih-Chieh, Coulom, Rémi, and Lin, Shun-Shii. Monte-Carlo simulation balancing in practice. In Proceedings of the 7th International Conference on Computers and Games, pp. 81–92. Springer-Verlag, 2011.
12. Kocsis, Levente and Szepesvári, Csaba. Bandit based Monte-Carlo planning. In Machine Learning: ECML 2006, pp. 282–293. Springer, 2006.
13. Krizhevsky, Alex, Sutskever, Ilya, and Hinton, Geoffrey E. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems, pp. 1097–1105, 2012.
14. Müller, Martin. Computer Go. Artif. Intell., 134(1-2):145–179, 2002.
15. Schraudolph, Nicol N, Dayan, Peter, and Sejnowski, Terrence J. Temporal difference learning of position evaluation in the game of Go. Advances in Neural Information Processing Systems, pp. 817–817, 1994.
16. Simonyan, Karen and Zisserman, Andrew. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014.
17. Sutskever, Ilya and Nair, Vinod. Mimicking Go experts with convolutional neural networks. In Artificial Neural Networks-ICANN 2008, pp. 101–110. Springer, 2008.
18. Szegedy, Christian, Liu, Wei, Jia, Yangqing, Sermanet, Pierre, Reed, Scott, Anguelov, Dragomir, Erhan, Dumitru, Vanhoucke, Vincent, and Rabinovich, Andrew. Going deeper with convolutions. arXiv preprint arXiv:1409.4842, 2014.