Monte Carlo Tree Search with macro-actions and heuristic route planning for the Physical Travelling Salesman Problem

2012 IEEE Conference on Computational Intelligence and Games, CIG 2012

Volumn , Issue , 2012, Pages 234-241

  Powley, Edward J ^a,b   Whitehouse, Daniel ^a,b   Cowling, Peter I ^a,b  

^a UNIVERSITY OF BRADFORD   (United Kingdom)

^b UNIVERSITY OF YORK   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COARSE-GRAINED; DOMAIN SPECIFIC; HUMAN PLAYERS; MONTE CARLO; MOVEMENT PLANNING; PER UNIT; POTENTIAL APPLICATIONS; REAL-TIME DOMAINS; ROUTE PLANNING; STEERING PROBLEMS; TRAVELLING SALESMAN PROBLEM; TREE SEARCH; VIDEO GAME;

ARTIFICIAL INTELLIGENCE; DECISION TREES; TRAVELING SALESMAN PROBLEM;

MOTION PLANNING;

EID: 84871963399     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CIG.2012.6374161     Document Type: Conference Paper

References (21)

1. E. L. Lawler, J. K. Lenstra, A. H. G. Rinnooy Kan, and D. B. Shmoys, Eds., The Traveling Salesman Problem: A Guided Tour of Combinatorial Optimization. John Wiley and Sons, 1985.
2. D. Perez, D. Robles, and P. Rohlfshagen, "The Physical Travelling Salesman Problem Competition Website," 2012. [Online]. Available: http://ptsp-game.net/
3. G. M. J.-B. Chaslot, S. Bakkes, I. Szita, and P. Spronck, "Monte-Carlo Tree Search: A New Framework for Game AI," in Proc. Artif. Intell. Interact. Digital Entert. Conf., Stanford Univ., California, 2008, pp. 216-217.
4. C.-S. Lee, M. Müller, and O. Teytaud, "Guest Editorial: Special Issue on Monte Carlo Techniques and Computer Go," IEEE Trans. Comp. Intell. AI Games, vol. 2, no. 4, pp. 225-228, Dec. 2010.
5. A. Rimmel, O. Teytaud, C.-S. Lee, S.-J. Yen, M.-H. Wang, and S.-R. Tsai, "Current Frontiers in Computer Go," IEEE Trans. Comp. Intell. AI Games, vol. 2, no. 4, pp. 229-238, 2010.
6. C. Browne, E. J. Powley, D. Whitehouse, S. M. Lucas, P. I. Cowling, P. Rohlfshagen, S. Tavener, D. Perez, S. Samothrakis, and S. Colton, "A Survey of Monte Carlo Tree Search Methods," IEEE Trans. Comp. Intell. AI Games, vol. 4, no. 1, pp. 1-43, 2012.
7. S. Samothrakis, D. Robles, and S. M. Lucas, "A UCT Agent for Tron: Initial Investigations," in Proc. IEEE Symp. Comput. Intell. Games, Dublin, Ireland, 2010, pp. 365-371.
8. N. G. P. Den Teuling, "Monte-Carlo Tree Search for the Simultaneous Move Game Tron," B.Sc. Thesis, Univ. Maastricht, Netherlands, 2011.
9. S. Samothrakis, D. Robles, and S. M. Lucas, "Fast Approximate Max-n Monte-Carlo Tree Search for Ms Pac-Man," IEEE Trans. Comp. Intell. AI Games, vol. 3, no. 2, pp. 142-154, 2011.
10. K. Q. Nguyen, T. Miyama, A. Yamada, T. Ashida, and R. Thawonmas, "ICE gUCT," Int. Comput. Entertain. Lab., Ritsumeikan Univ., Tech. Rep., 2011.
11. N. Ikehata and T. Ito, "Monte-Carlo Tree Search in Ms. Pac-Man," in Proc. IEEE Conf. Comput. Intell. Games, Seoul, South Korea, 2011, pp. 39-46.
12. D. Perez, P. Rohlfshagen, and S. M. Lucas, "Monte-Carlo Tree Search for the Physical Travelling Salesman Problem," in Proc. EvoApplications, 2012, pp. 255-264.
13. Atari, "Asteroids." [Online]. Available: http://www.atari.com/ asteroids
14. H. Lieberman, "How to color in a coloring book," ACM SIGGRAPH Comput. Graph., vol. 12, no. 3, pp. 111-116, 1978.
15. J. L. Bentley, "Experiments on Traveling Salesman Heuristics," in Proc. 1st Annu. ACM-SIAM Symp. Disc. Alg., 1990, pp. 91-99.
16. S. Lin, "Computer solutions of the traveling salesman problem," Bell Syst. Tech. J., vol. 44, pp. 2245-2269, 1965.
17. D. S. Johnson and L. A. McGeoch, "The Traveling Salesman Problem: A Case Study in Local Optimization," in Local Search in Combinatorial Optimization, E. H. L. Aarts and J. K. Lenstra, Eds. John Wiley and Sons, 1997, pp. 215-310.
18. G. Snook, "Simplified 3D Movement and Pathfinding Using Navigation Meshes," in Game Programming Gems. Charles River Media, 2000, pp. 288-304.
19. L. Kocsis and C. Szepesvári, "Bandit based Monte-Carlo Planning," in Euro. Conf. Mach. Learn., J. Fürnkranz, T. Scheffer, and M. Spiliopoulou, Eds. Berlin, Germany: Springer, 2006, pp. 282-293.
20. BoardGameGeek, "Settlers of Catan." [Online]. Available: http://boardgamegeek.com/boardgame/13/the-settlers-of-catan
21. A. Botea, Martin Müller, and J. Schaeffer, "Near optimal hierarchical path-finding," Journal of Game Development, vol. 1, pp. 7-28, 2004.