FUEGO-An open-source framework for board games and go engine based on Monte Carlo tree search

IEEE Transactions on Computational Intelligence and AI in Games

Volumn 2, Issue 4, 2010, Pages 259-270

  Enzenberger, Markus ^c   Müller, Martin ^a   Arneson, Broderick ^a   Segal, Richard ^b  

^a UNIVERSITY OF ALBERTA   (Canada)

^b IBM T J WATSON RESEARCH CENTER   (United States)

^c NONE

Author keywords

Computer game playing; Computer Go; Fuego; man machine matches; Monte Carlo tree search; open source software; software frameworks

Indexed keywords

COMPUTER GAME; COMPUTER GO; FUEGO; MAN-MACHINE MATCHES; MONTE CARLO; OPEN SOURCE SOFTWARE; SOFTWARE FRAMEWORKS;

HUMAN COMPUTER INTERACTION; MONTE CARLO METHODS; OPEN SYSTEMS;

COMPUTER SOFTWARE REUSABILITY;

EID: 78951484236     PISSN: 1943068X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCIAIG.2010.2083662     Document Type: Article

References (54)

1. R. Coulom, "Efficient selectivity and backup operators in Monte-Carlo tree search," in Proceedings of the 5th International Conference on Computer and Games, J. van den Herik, P. Ciancarini, and H. Donkers, Eds. Berlin, Germany: Springer-Verlag, Jun. 2006, vol. 4630/2007, pp. 72-83 [Online]. Available: http://remi.coulom.free.fr/CG2006/CG2006.pdf
2. L. Kocsis and C. Szepesvári, "Bandit based Monte-Carlo planning," in Machine Learning: ECML 2006, ser. Lecture Notes in Computer Science. Berlin, Germany: Springer-Verlag, 2006, vol. 4212, pp. 282-293.
3. S. Gelly, "A contribution to reinforcement learning; Application to computer-Go" Ph.D. dissertation, Université Paris-Sud, Paris, France, 2007.
4. G. Chaslot, C. Fiter, J.-B. Hoock, A. Rimmel, and O. Teytaud, "Adding expert knowledge and exploration in Monte-Carlo tree search," in Advances in Computer Games, ser. Lecture Notes in Computer Science, J. van den Herik and P. Spronck, Eds. Berlin, Germany: Springer-Verlag, 2010, vol. 6048, pp. 1-13.
5. S. Gelly and D. Silver, "Combining online and offline knowledge in UCT," in Proc. 24th Int. Conf. Mach. Learn., 2007, pp. 273-280 [Online]. Available: http://dx.doi.org/10.1145/1273496.1273531
6. S. Gelly, J.-B. Hoock, A. Rimmel, O. Teytaud, and Y. Kalemkarian, "The parallelization of Monte-Carlo planning-Parallelization of MC-planning," in ICINCO-ICSO, J. Filipe, J. Andrade-Cetto, and J.-L. Ferrier, Eds. Setubal, Portugal: INSTICC Press, 2008, pp. 244-249.
7. T. Cazenave and N. Jouandeau, "A parallel Monte-Carlo tree search algorithm," in Computers and Games, ser. Lecture Notes in Computer Science, J. van den Herik, X. Xu, Z. Ma, and M. Winands, Eds. Berlin, Germany: Springer-Verlag, 2008, vol. 5131, pp. 72-80.
8. G. Chaslot, M. Winands, and J. van den Herik, "Parallel Monte-Carlo tree search," in Proceedings of the 6th International Conference on Computer and Games, ser. Lecture Notes in Computer Science. Berlin, Germany: Springer-Verlag, 2008, vol. 5131, pp. 60-71 [Online]. Available: http://www.cs.unimaas.nl/g.chaslot/papers/parallelMCTS. pdf
9. Y. Bjornsson and H. Finnsson, "Cadiaplayer: A simulation-based general game player," IEEE Trans. Comput. Intell. AI Games, vol. 1, no. 1, pp. 4-15, Mar. 2009.
10. R. Lorentz, "Amazons discover Monte-Carlo," in Computers and Games, ser. Lecture Notes in Computer Science, J. van den Herik, X. Xu, Z. Ma, and M.Winands, Eds. Berlin, Germany: Springer-Verlag, 2008, vol. 5131, pp. 13-24.
11. B. Arneson, R. Hayward, and P. Henderson, "Wolve wins Hex tournament," Int. Comput. Games Assoc. J., vol. 32, no. 1, pp. 48-53, 2009.
12. B. Arneson, R. Hayward, and P. Henderson, "Mohex wins Hex tournament," Int. Comput. Games Assoc. J., vol. 32, no. 2, pp. 114-116, 2009.
13. F. Teytaud and O. Teytaud, "Creating an upper-confidence-tree program for Havannah," in Advances in Computer Games, ser. Lecture Notes in Computer Science, J. van den Herik and P. Spronck, Eds. Berlin, Germany: Springer-Verlag, 2010, vol. 6048, pp. 65-74.
14. F. de Mesmay, A. Rimmel, Y. Voronenko, and M. Püschel, "Banditbased optimization on graphs with application to library performance tuning," in ICML, ser. ACM International Conference Proceedings, A. P. Danyluk, L. Bottou, and M. L. Littman, Eds. New York: ACM, 2009, vol. 382, pp. 92-92.
15. M. P. D. Schadd, M. H. M. Winands, H. J. van den Herik, G. Chaslot, and J. W. H. M. Uiterwijk, "Single-player Monte-Carlo tree search," in Computers and Games, ser. Lecture Notes in Computer Science, J. van den Herik, X. Xu, Z. Ma, and M. Winands, Eds. Berlin, Germany: Springer-Verlag, 2008, vol. 5131, pp. 1-12.
16. A. Rimmel, "Bandit-based optimization on graphs with application to library performance tuning," Ph.D. dissertation, Ecole doctorale d'informatique, Université Paris-Sud, Paris, France, 2009.
17. H. Nakhost and M. Müller, "Monte-Carlo exploration for deterministic planning," in Proc. 21st Int. Joint Conf. Artif. Intell., Pasadena, CA, 2009, pp. 1766-1771.
18. N. Sturtevant, "An analysis of UCT in multi-player games," in Computers and Games, ser. Lecture Notes in Computer Science, J. van den Herik, X. Xu, Z. Ma, and M. Winands, Eds. Berlin, Germany: Springer-Verlag, 2008, vol. 5131, pp. 37-49.
19. Free Software Foundation, GNU Go, 2009 [Online]. Available: http:// www.gnu.org/software/gnugo/
20. J. Hoffmann and B. Nebel, "The FF planning system: Fast plan generation through heuristic search," J. Artif. Intell. Res., vol. 14, pp. 253-302, 2001.
21. S. Gelly, Y. Wang, R. Munos, and O. Teytaud, "Modification of UCT with patterns in Monte-Carlo Go," 2006 [Online]. Available: http://hal. inria.fr/inria-00117266/en
22. D. Dailey, "Simple MC reference bot and specification," 2008 [Online]. Available: http://computer-go.org/pipermail/computer-go/2008-October/ 016624.html
23. L. Lew, "Library of effective Go routines," 2010 [Online]. Available: http://github.com/lukaszlew/libego
24. P. Baudis, "Pachi simple Go/baduk/weiqi bot," 2010 [Online]. Available: http://repo.or.cz/w/pachi.git
25. N.Wedd, "Human-computer Go challenges," 2009 [Online].Available: http://www.computer-go.info/h-c/index.html
26. Y. Sato and D. Takahashi, "A Shogi program based on Monte-Carlo tree search," in Proc. 13th Game ProgrammingWorkshop, 2008, pp. 1-8.
27. S. Lopez, "Rybka's Monte Carlo analysis," 2008 [Online]. Available: http://www.chessbase.com/newsdetail.asp?newsid=5075
28. A. Kierulf, "Smart game board: A workbench for game-playing programs, with Go and Othello as case studies" Ph.D. dissertation, Dept. Comput. Sci., ETH Zürich, Zürich, Switzerland, 1990.
29. A. Kierulf, R. Gasser, P. M. Geiser, M. Müller, J. Nievergelt, and C. Wirth, H. Maurer, Ed., "Every interactive system evolves into hyperspace: The case of the Smart Game Board," Hypertext/Hypermedia, vol. 276, pp. 174-180, 1991.
30. M. Müller, "Computer Go as a sum of local games: An application of combinatorial game theory," Ph.D. dissertation, Dept. Comput. Sci., ETH Zürich, Zürich, Switzerland, 1995.
31. M. Müller, "Counting the score: Position evaluation in computer Go," Int. Comput. Games Assoc. J., vol. 25, no. 4, pp. 219-228, 2002.
32. M. Enzenberger and M. Müller, "Fuego homepage," 2008 [Online]. Available: http://fuego.sf.net/
33. GNU Lesser General Public License, 2008 [Online]. Available: http:// www.gnu.org/licenses/lgpl.html
34. B. Dawes, "Boost C++ libraries," 2008 [Online]. Available: http://www.boost.org/
35. G. Farnebäck, "GTP-Go text protocol," 2008 [Online]. Available: http://www.lysator.liu.se/∼gunnar/gtp/
36. P. Pogonyshev, "Quarry homepage," 2009 [Online]. Available: http:// home.gna.org/quarry/
37. M. Enzenberger, "GoGui," 2009 [Online]. Available: http://gogui.sf. net/
38. A. Hollosi, "SGF file format," 2009 [Online]. Available: http://www. red-bean.com/sgf/
39. M. Buro, "ProbCut: An effective selective extension of the alpha-beta algorithm," Int. Comput. Chess Assoc. J., vol. 18, no. 2, pp. 71-76, Jun. 1995.
40. D. Silver, "Reinforcement learning and simulation-based search in computer Go," Ph.D. dissertation, Dept. Comput. Sci., Univ. Alberta, Edmonton, AB, Canada, 2009.
41. M. Enzenberger and M. Müller, "A lock-free multithreaded Monte-Carlo tree search algorithm," in Advances in Computer Games, ser. Lecture Notes in Computer Science, J. van den Herik and P. Spronck, Eds. Berlin, Germany: Springer-Verlag, 2010, vol. 6048, pp. 14-20.
42. Intel Corporation, "Intel 64 and IA-32 architectures software developer's manual-Volume 3A: System programming guide, part 1," Order No. 253668-029US, 2008.
43. G. Chaslot, M. Winands, J. Uiterwijk, J. van den Herik, and B. Bouzy, "Progressive strategies for Monte-Carlo tree search," New Math. Natural Comput., vol. 4, no. 3, pp. 343-357, 2008.
44. D. B. Benson, "Life in the game of Go," Inf. Sci., vol. 10, pp. 17-29, 1976.
45. B. Lambrechts, "Opening books for Fuego," 2010 [Online]. Available: http://gnugo.baduk.org/fuegoob.htm
46. P. Audouard, G. Chaslot, J.-B. Hoock, A. Rimmel, J. Perez, and O. Teytaud, "Grid coevolution for adaptive simulations; application to the building of opening books in the game of Go," in Applications of Evolutionary Computing, ser. Lecture Notes in Computer Science. Berlin, Germany: Springer-Verlag, 2009, vol. 5484, pp. 323-332.
47. A. Kishimoto, "Correct and efficient search algorithms in the presence of repetitions," Ph.D. dissertation, Dept. Comput. Sci., Univ. Alberta, Edmonton, AB, Canada, 2005.
48. M. Müller, "Solving 5×5 amazons," in The 6th Game Programming Workshop (GPW 2001). Hakone, Japan: Information Processing Society of Japan, 2001, vol. 2001, pp. 64-71.
49. D. Tom and M. Müller, "A study of UCT and its enhancements in an artificial game," in Advances in Computer Games, ser. Lecture Notes in Computer Science, J. van den Herik and P. Spronck, Eds. Berlin, Germany: Springer-Verlag, 2010, vol. 6048, pp. 55-64 [Online]. Available: http://hal.inria.fr/inria-00386477/en/
50. M. Müller and Z. Li, "Locally informed global search for sums of combinatorial games," in Computers and Games: 4th International Conference, CG 2004, ser. Lecture Notes in Computer Science, J. van den Herik, Y. Björnsson, and N. Netanyahu, Eds. Berlin, Germany: Springer-Verlag, 2006, vol. 3846, pp. 273-284.
51. L. Zhao and M. Müller, "Using artificial boundaries in the game of Go," in Computer and Games. 6th International Conference, ser. Lecture Notes in Computer Science, J. van den Herik, X. Xu, Z. Ma, and M. Winands, Eds. Berlin, Germany: Springer-Verlag, 2008, vol. 5131, pp. 81-91.
52. OGS Online Go Server, "Player profile-Fuego9,"×9-1h 2010 [Online]. Available: http://www.online-go.com/profile.php?user=26504
53. D. Dailey, "Computer Go server," 2008 [Online].Available: http://cgos. boardspace.net/
54. M. Müller, "Fuego-CGOS history," 2010 [Online]. Available: http:// http://webdocs.cs.ualberta.ca/∼mmueller/fuego/cgos.html