Intelligent agents for the game of go

IEEE Computational Intelligence Magazine

Volumn 5, Issue 4, 2010, Pages 28-42

  Hoock, Jean Baptiste ^a   Rimmel, Arpad ^a   Teytaud, Fabien ^a   Teytaud, Olivier ^a   Lee, Chang Shing ^b   Wang, Mei Hui ^b  

^a UNIVERSITÉ PARIS SACLAY   (France)

^b NATIONAL UNIVERSITY OF TAINAN   (Taiwan)

Author keywords

[No Author keywords available]

Indexed keywords

ALPHA-BETA; COMPUTER GO; DECISION-TAKING; DISCRETE-TIME CONTROL; HUMAN EXPERTISE; LEARNING TECHNIQUES; MONTE CARLO; PLANNING PROBLEM; TREE SEARCH; TWO SECTION; VALUE FUNCTIONS;

ARTIFICIAL INTELLIGENCE;

INTELLIGENT AGENTS;

EID: 77958488969     PISSN: 1556603X     EISSN: None     Source Type: Journal    
DOI: 10.1109/MCI.2010.938360     Document Type: Article

References (34)

1. R. Coulom, "Efficient selectivity and backup operators in Monte-Carlo tree search," in Proc. 5th Int. Conf. Computers and Games, P. Ciancarini and H. J. van den Herik, Eds. Turin, Italy, 2006.
2. G. Chaslot, J.-T. Saito, B. Bouzy, J. W. H. M. Uiterwijk, and H. J. van den Herik. (2006). Monte-Carlo strategies for computer go. Proc. 18th BeNeLux Conf. Artificial Intelligence, P.-Y. Schobbens, W. Vanhoof, and G. Schwanen, Eds. Namur, Belgium, pp. 83-91 [Online]. Available: http://www.cs.unimaas.nl/g. chaslot/papers/mcscg.pdf
3. L. Kocsis and C. Szepesvari, "Bandit based Monte-Carlo planning," in Proc. 15th European Conf. Machine Learning (ECML), 2006, pp. 282-293.
4. R. Coulom, "Computing elo ratings of move patterns in the game of go," in Proc. Computer Games Workshop, Amsterdam, The Netherlands, 2007.
5. S. Gelly and D. Silver, "Combining online and off line knowledge in UCT," in Proc. 24th Int. Conf. Machine Learning (ICML'07). New York, NY: ACM Press, 2007, pp. 273- 280.
6. C.-S. Lee, M.-H. Wang, G. Chaslot, J.-B. Hoock, A. Rimmel, O. Teytaud, S.-R. Tsai, S.-C. Hsu, and T.-P. Hong. (2009). The computational intelligence of MoGo revealed in Taiwan's Computer Go Tournaments. IEEE Trans. Comput. Intell. AI in Games [Online]. Available: http://hal.inria.fr/inria-00369786/en/
7. F. Teytaud and O. Teytaud. (2009). Creating an upper-confidence-tree program for Havannah. AnglaisACG 12. Pamplona Espagne, pp. 73-89 [Online]. Available: http://hal.inria. fr/inria-00380539/en/
8. S. Sharma, Z. Kobti, and S. Goodwin, "Knowledge generation for improving simulations in UCT for general game playing," in Proc. 21st Australasian Joint Conf. Artificial Intelligence (AI'08). Berlin: Springer-Verlag, 2008, pp. 49-55.
9. P. Rolet, M. Sebag, and O. Teytaud, "Optimal active learning through billiards and upper confidence trees in continous domains," in Proc. ECML Conf., 2009.
10. F. De Mesmay, A. Rimmel, Y. Voronenko, and M. Püschel. (2009). Bandit-based optimization on graphs with application to library performance tuning. AnglaisICML. Montréal, Canada [Online]. Available: http://hal.inria.fr/inria-00379523/en/
11. P. Audouard, G. Chaslot, J.-B. Hoock, J. Perez, A. Rimmel, and O. Teytaud, "Grid coevolution for adaptive simulations; application to the building of opening books in the game of Go," in Proc. EvoGames. Springer, 2009, pp. 323-332.
12. Y. Wang and S. Gelly, "Modifications of UCT and sequence-like simulations for Monte-Carlo Go," in Proc. IEEE Symp. Computational Intelligence and Games, Honolulu, Hawaii, 2007, pp. 175-182.
13. S. Gelly, J. B. Hoock, A. Rimmel, O. Teytaud, and Y. Kalemkarian, "The parallelization of Monte-Carlo planning," in Proc. Int. Conf. Informatics in Control, Automation and Robotics (ICINCO'08), 2008, pp. 198-203.
14. M. Enzenberger and M. Müller, "A lock-free multithreaded Monte-Carlo tree search algorithm," in Proceedings of Advances in Computer Games 12. 2009.
15. R. Coulom, "Lockless hash table and other parallel search ideas," 2008, post on the computer-go mailing list.
16. T. Cazenave and N. Jouandeau, "On the parallelization of UCT," in Proc. CGW07, 2007, pp. 93-101.
17. H. Kato and I. Takeuchi. (2008, Nov.). Parallel monte-carlo tree search with simulation servers. Proc. 13th Game Programming Workshop (GPW-08) [Online]. Available: http:// www.gggo.jp/publications/gpw08-private.pdf
18. G. Chaslot, M. Winands, J. Uiterwijk, H. van den Herik, and B. Bouzy. (2007). Progressive strategies for Monte-Carlo tree search. Proc. 10th Joint Conf. Information Sciences ( JCIS 2007), P. Wang et al., Eds. World Scientific Publishing Co. Pte. Ltd., pp. 655-661 [Online]. Available: papers\pMCTS.pdf
19. G. Chaslot, C. Fiter, J.-B. Hoock, A. Rimmel, and O. Teytaud. (2009). Adding expert knowledge and exploration in Monte-Carlo Tree Search. AnglaisAdvances in Computer Games. Pamplona Espagne: Springer [Online]. Available: http://hal.inria.fr/inria-00386477/en/
20. R. Hunter, "Nakade & ishi-no-shita," British Go J., vol.128, pp. 8-12, 2002.
21. (2010). Intelligent Go [Online]. Available: http://intelligentgo.org
22. T. Cazenave and B. Helmstetter, "Combining tactical search and monte-carlo in the game of go," in Proc. IEEE CIG 2005, 2005, pp. 171-175.
23. A. Moreno, A. Valls, D. Isern, and D. Sanchez, "Applying agent technology to healthcare: The crusma experience," IEEE Intell. Syst., vol.21, no.6, pp. 63-67, 2006. (Pubitemid 44936723)
24. C. S. Lee and M. H. Wang, "Ontology-based computational intelligent multi-agent and its application to CMMI assessment," Appl. Intell., vol.30, no.3, pp. 203-219, 2009.
25. B. Orgun and J. Vu, "Hl7 ontology and mobile agents for interoperability in heterogeneous medical information systems," Comput. Biol. Med., vol.36, no.7-8, pp. 817-836, 2006.
26. C. S. Lee, M. H. Wang, and J. J. Chen, "Ontology-based intelligent decision support agent for CMMI project monitoring and control," Int. J. Approx. Reason., vol.48, pp. 62-76, 2008.
27. M. H. Wang, C. S. Lee, K. L. Hsieh, C. Y. Hsu, G. Acampora, and C. C. Chang, "Ontology-based multi-agents for intelligent healthcare applications," J. Ambient Intell. Humanized Comput., vol.1, no.2, pp. 111-131, 2010.
28. V. Mnih, C. Szepesvári, and J.-Y. Audibert, "Empirical Bernstein stopping," in Proc. 25th Int. Conf. Machine Learning (ICML'08). New York, NY: ACM, 2008, pp. 672-679.
29. J.-B. Hoock and O. Teytaud, "Bandit-based genetic programming," in Proc. EuroGP 2010, to be published.
30. M. Lees, B. Logan, and G. K. Theodoropoulos, "Agents, games, and HLA," Simul. Model. Practice Theory, vol.14, no.6, pp. 752-767, 2006.
31. D. B. Fogel, "Let the games begin," IEEE Comput. Intell. Mag., vol.3, no.3, pp. 3-3, 2008.
32. J. Mendel, L. Zadeh, E. Trillas, R. Yager, L. Lawry, H. Hagras, and S. Guadarrama, "What computing with words means to me," IEEE Comput. Intell. Mag., vol.5, no.1, pp. 20-26, 2010.
33. G. Acampora, M. Gaeta, and V. Loia, "Exploring e-learning knowledge through ontological memetic agents," IEEE Comput. Intell. Mag., vol.5, no.2, pp. 66-77, 2010.
34. Wikipedia. (2009). Havannah [Online]. Available: http://en.wikipedia.org/ wiki/ Havannah