Designing an evolutionary strategizing machine for game playing and beyond

IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews

Volumn 37, Issue 4, 2007, Pages 583-593

  Sipper, Moshe ^a   Azaria, Yaniv ^a,b   Hauptman, Ami ^a   Shichel, Yehonatan ^a  

^a BEN GURION UNIVERSITY OF THE NEGEV   (Israel)

^b Transparency Software   (Israel)

Author keywords

Backgammon; Chess; Evolutionary algorithms; Evolving game strategies; Genetic programming; Robocode; Strategizing

Indexed keywords

EVOLUTIONARY STRATEGIZING MACHINE; EVOLVING GAME STRATEGY;

EVOLUTIONARY ALGORITHMS; HUMAN COMPUTER INTERACTION; INTELLIGENT SYSTEMS; MACHINE DESIGN;

GENETIC PROGRAMMING;

EID: 34447331426     PISSN: 10946977     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCC.2007.897326     Document Type: Article

References (39)

1. S. L. Epstein, "Game playing: The nextmoves," in Proc. 16th Natl. Conf. Artif. Intell. Menlo Park, CA: AAAI, 1999, pp. 987-993.
2. J. E. Laird and M. van Lent, "Human-level AI's killer application: Interactive computer games," in AAAI-00: Proc. 17th Natl. Conf. Artif. Intell. Cambridge, MA: MIT Press, 2000, pp. 1171-1178.
3. M. Sipper, Machine Nature: The Coming Age of Bio-Inspired Computing New York: McGraw-Hill, 2002.
4. A. Tettamanzi and M. Tomassini, Soft Computing: Integrating Evolutionary, Neural, and Fuzzy Systems. Berlin, Germany: Springer-Verlag, 2001.
5. D. B. Fogel, Evolutionary Computation: Toward a New Philosophy of Machine Intelligence, 2nd ed. Piscataway, NJ: IEEE Press, 1999.
6. M. D. Vose, The Simple Genetic Algorithm: Foundations and Theory. Cambridge, MA: MIT Press, 1999.
7. Z. Michalewicz, Genetic Algorithms + Data Structures = Evolution Programs, 3rd ed. Heidelberg, Germany: Springer-Verlag, 1996.
8. J. R. Koza, Genetic Programming: On the Programming of Computers by Means of Natural Selection. Cambridge, MA: MIT Press, 1992.
9. J. H. Holland, Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence, 2nd ed. Cambridge, MA: MIT Press, 1992.
10. L. J. Fogel, A. J. Owens, and M. J. Walsh, Artificial Intelligence Through Simulated Evolution. New York: Wiley, 1966.
11. N. L. Cramer, "A representation for the adaptive generation of simple sequential programs," in Proc. 1st Int. Conf. Genetic Algorithms, J. J. Grefenstette, Ed. Mahwah, NJ: Erlbaum, 1985, pp. 183-187.
12. Y. Azaria and M. Sipper, "GP-Gammon: Using genetic programming to evolve backgammon players," in Proc. 8th Eur. Conf. Genetic Program. Lecture Notes in Computer Science, vol. 3447, M. Keijzer, A. Tettamanzi, P. Collet, J. van Hemert, andM. Tomassini, Eds. Heidelberg, Germany: Springer-Verlag, 2005, vol. 3447, pp. 132-142.
13. A. Hauptman and M. Sipper, "GP-EndChess: Using genetic programming to evolve chess endgame players," in Proc. 8th Eur. Conf. Genetic Program. Lecture Notes in Computer Science, vol. 3447, M. Keijzer, A. Tettamanzi, P. Collet, J. van Hemert, and M. Tomassini, Eds. Heidelberg, Germany: Springer-Verlag, 2005, pp. 120-131.
14. Y. Shichel, E. Ziserman, and M. Sipper, "GP-Robocode: Using genetic programming to evolve robocode players," in Proc. 8th Eur. Conf. Genetic Program. Lect. Notes Comput. Sci., vol. 3447, M. Keijzer, A. Tettamanzi, P. Collet, J. van Hemert, and M. Tomassini, Eds. Heidelberg, Germany: Springer-Verlag, 2005, pp. 143-154.
15. A. L. Samuel, "Some studies in machine learning using the game of checkers," IBM J. Res. Dev., vol. 3, no. 3, pp. 210-229, Jul. 1959.
16. G. Kendall and G. Whitwell, "An evolutionary approach for the tuning of a chess evaluation function using population dynamics," in Proc. 2001 Congr. Evol. Comput. Piscataway, NJ: IEEE Press, pp. 995-1002.
17. N. Chomsky, Language and Thought. Wakefield, RI: Moyer Bell, 1993.
18. H. Abelson, G. J. Sussman, and J. Sussman, Structure and Interpretation of Computer Programs, 2nd ed. Cambridge, MA: MIT Press, 1996.
19. G. Tesauro, Software Source Code Benchmark player "pubeval.c", 1993, [Online]. Available: http://www.bkgm.com/rgb/rgb.cgi?view+610.
20. J. Paredis, "Coevolutionary computation," Artif. Life, vol. 2, no. 4, pp. 355-375, 1995.
21. C. D. Rosin and R. K. Belew, "New methods for competitive coevolution," Evol. Comput., vol. 5, no. 1, pp. 1-29, 1997.
22. W. D. Hillis, "Co-evolving parasites improve simulated evolution as an optimization procedure," Physica D, vol. 42, pp. 228-234, 1990.
23. M. A. Potter and K.A. De Jong, "Cooperative coevolution: An architecture for evolving coadapted subcomponents," Evol. Comput. vol. 8, no. 1, pp. 1-29, Spring 2000.
24. C.-A. Peña-Reyes and M. Sipper, "Fuzzy CoCo: A cooperative-coevolutionary approach to fuzzy modeling," IEEE Trans. Fuzzy Syst., vol. 9, no. 5, pp. 727-737, Oct. 2001.
25. P. J. Angeline and J. B. Pollack, "Competitive environments evolve better solutions for complex tasks," in Proc. 5th Int. Conf. Genetic Algorithms, S. Forrest, Ed. San Mateo, CA: Morgan Kaufmann, 1993, pp. 264-270.
26. L. A. Panait and S. Luke, "A comparison of two competitive fitness functions," in GECCO 2002: Proc. Genetic Evol. Comput. Conf., W. B. Langdon, E. Cantü-Paz, K. Mathias, R. Roy, D. Davis, R. Poli, K. Balakrishnan, V. Honavar, G. Rudolph, J.Wegener, L. Bull, M. A. Potter, A. C. Schultz, J. F. Miller, E. Burke, and N. Jonoska, Eds. San Francisco, CA: Morgan Kaufmann, pp. 503-511.
27. P. Darwen, "Why co-evolution beats temporal-difference learning at backgammon for a linear architecture, but not a non-linear architecture," in Proc. 2001 Congr. Evol. Comput., Seoul Korea, pp. 1003-1010.
28. D. Qi and R. Sun, "Integrating reinforcement learning, bidding and genetic algorithms," in Proc. Int. Conf. Intell. Agent Technol. Los Alamitos, CA: IEEE Computer Society Press, 2003, pp. 53-59.
29. S. Sanner, J. R. Anderson, C. Lebiere, and M. Lovett, "Achieving efficient and cognitively plausible learning in backgammon," in Proc. 17th Int. Conf. Mach. Learn., P. Langley, Ed. San Francisco, CA: Morgan Kaufmann, 2000, pp. 823-830.
30. J. B. Pollack, A. D. Blair, and M. Land, "Coevolution of a backgammon player," in Artif. Life V: Proc. 5th Int. Workshop Synth. Simul. Living Syst., C. G. Langton and K. Shimohara, Eds. Cambridge, MA: MIT Press, 1997, pp. 92-98.
31. J. R. Koza, F. H. Bennett III, D. Andre, andM.A.Keane, Genetic Programming III: Darwinian Invention and Problem Solving. San Francisco, CA: Morgan Kaufmann, 1999.
32. E. M. A. Ronald, M. Sipper, and M. S. Capcarrère, "Design, observation, surprise! A test of emergence," Artif. Life, vol. 5, no. 3, pp. 225-239, Summer 1999.
33. J. R. Koza, M. A. Keane, M. J. Streeter, W. Mydlowec, J. Yu, and G. Lanza, Genetic Programming IV: Routine Human-Competitive Machine Intelligence. Norwell, MA: Kluwer Academic, 2003.
34. F. C. Bartlett, Remembering: An Experimental and Social Study. Cambridge, U.K.: Cambridge Univ. Press, 1932.
35. H. A. Simon and K. Gilmartin, "A simulation of memory for chess positions," Cogn. Psychol., vol. 5, no. 1, pp. 29-46, Jul. 1973.
36. F. Gobet and H. A. Simon, "Templates in chess memory: A mechanism for recalling several boards," Cogn. Psychol., vol. 31, pp. 1-40, 1996.
37. H. Wang, "A variant to Turing's theory of computing machines," J. ACM, vol. 4, pp. 63-92, 1957.
38. J.-Y. Perrier, M. Sipper, and J. Zahnd, "Toward a viable, self-reproducing universal computer," Physica D, vol. 97, pp. 335-352, 1996.
39. A. Newell and H. A. Simon, "GPS, a program that simulates human thought," in Computers and Thought, E. A. Feigenbaum and J. Feldman, Eds. New York: McGraw-Hill, 1963, pp. 279-296.