A platform for evolving intelligently interactive adversaries

BioSystems

Volumn 85, Issue 1, 2006, Pages 72-83

  Fogel, David B ^a   Hays, Timothy J ^a   Johnson, Douglas R ^b  

^a NATURAL SELECTION INC   (United States)

^b Digenetics Inc ^*  (United States)

Author keywords

Agent based; Evolutionary algorithms; Evolutionary computation; Flight simulator; Neural networks; Nonplayer characters; Object neural networks; Video games

Indexed keywords

ALGORITHM; ARTIFICIAL NEURAL NETWORK; COMPUTER AIDED DESIGN; EVOLUTION; RECREATIONAL ACTIVITY; SOFTWARE;

ARTICLE; BEHAVIOR; COMPUTER PROGRAM; GENETIC TRAIT; SIMULATION; WAR;

EID: 33744906793     PISSN: 03032647     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.biosystems.2006.02.010     Document Type: Article

References (61)

1. Axelrod R. The evolution of strategies in the iterated prisoner's dilemma. In: Davis L.D. (Ed). Genetic Algorithms and Simulated Annealing (1987), Morgan Kaufmann, San Mateo, CA 32-41
2. Bäck T., Hammel U., and Schwefel H.-P. Evolutionary computation: comments on the history and current state. IEEE Trans. Evol. Comput. 1 1 (1997) 3-17
3. Chellapilla K., and Fogel D.B. Evolving neural networks to play checkers without expert knowledge. IEEE Trans. Neural Networks 10 6 (1999) 1382-1391
4. Chellapilla K., and Fogel D.B. Evolution, neural networks, games, and intelligence. Proc. IEEE 87 9 (1999) 1471-1496
5. Chellapilla K., and Fogel D.B. Evolving an expert checkers playing program without using human expertise. IEEE Trans. Evol. Comput. 5 4 (2001) 422-428
6. Chong S.Y., and Yao X. The impact of noise on iterated prisoner's dilemma with multiple levels of cooperation. Proceedings of the 2004 Congress on Evolutionary Computation (2004), IEEE Press, Piscataway, NJ 348-355
7. Chong S.Y., and Yao X. Behavioral diversity, choices and noise in the iterated prisoner's dilemma. IEEE Trans. Evol. Comput. 9 6 (2005) 540-551
8. Corno F., Sanchez E., and Squillero G. Exploiting co-evolution and a modified island model to climb the corewar hill. Proceedings of the 2003 Congress on Evolutionary Computation (2003), IEEE Press, Piscataway, NJ 2222-2229
9. Corno F., Sanchez E., and Squillero G. On the evolution of corewar warriors. Proceedings of the 2004 Congress on Evolutionary Computation (2005), IEEE Press, Piscataway, NJ 133-138
10. Corno F., Sanchez E., and Squillero G. Evolving assembly programs: how games help microprocessor validation. IEEE Trans. Evol. Comput. 9 6 (2005) 695-706
11. Credit Suisse First Boston report, May 15, 2002, pp. 7-8, 11.
12. Darwen P.J. Why co-evolution beats temporal difference learning at backgammon for a linear architecture, but not a nonlinear architecture. Proceedings of the 2001 Congress on Evolutionary Computation (2001), IEEE Press, Piscataway, NJ 1003-1010
13. Darwen P.J., and Yao X. Does extra genetic diversity maintain escalation in a co-evolutionary arms race. Int. J. Knowledge Based Intell. Eng. Syst. 4 3 (2000) 191-200
14. Editorial, 2002. The video games industry. Global Media.
15. Editorial, 2003. Market focus: video games-to the next level. Business Company Resource Center, PR Week, p. 19.
16. Ficici S.G., Melnik O., and Pollack J.B. A game-theoretic and dynamical-systems analysis of selection methods in coevolution. IEEE Trans. Evol. Comput. 9 6 (2005) 580-602
17. Fogel D.B. Evolving behaviors in the iterated prisoner's dilemma. Evol. Comput. 1 1 (1993) 77-97
18. Fogel D.B. On the relationship between the duration of an encounter and the evolution of cooperation in the iterated prisoner's dilemma. Evol. Comput. 3 3 (1995) 349-363
19. Fogel D.B. Blondie24: Playing at the Edge of AI (2002), Morgan Kaufmann, San Francisco, CA
20. Fogel D.B. Evolving strategies in blackjack. Proceedings of the 2004 Congress on Evolutionary Computation (2004), IEEE Press, Piscataway, NJ 1427-1432
21. Fogel D.B., and Beyer H.-G. Do evolutionary processes minimize expected losses?. J. Theor. Biol. 207 (2000) 117-123
22. Fogel D.B., Fogel G.B., and Andrews P.C. On the instability of evolutionary stable strategies. Biosystems 44 (1997) 135-152
23. Fogel D.B., Fogel G.B., and Ohkura K. Multiple-vector self-adaptation in evolutionary algorithms. Biosystems 61 2-3 (2001) 155-162
24. Fogel D.B., Hays T.J., and Johnson D.R. A platform for evolving characters in competitive games. Proceedings of the 2004 Congress on Evolutionary Computation (2004), IEEE Press, Piscataway, NJ 1420-1426
25. Fogel D.B., Hays T.J., Hahn S.L., and Quon J. A self-learning evolutionary chess program. Proc. IEEE 92 12 (2004) 1947-1954
26. Fogel, D.B., Blair, A.D., Miikkulainen, R. (Eds.), 2005. IEEE Transactions on Evolutionary Computation: Special Issue on Evolutionary Computation and Games, vol. 9. p. 6.
27. Fogel G.B., Fogel D.B., and Andrews P.C. On the instability of evolutionary stable strategies in small populations. Ecol. Model. 109 (1998) 646-650
28. Franken N., and Engelbrecht A.P. Comparing PSO structures to learn the game of checkers from zero knowledge. Proceedings of the 2003 Congress on Evolutionary Computation (2003), IEEE Press, Piscataway, NJ 234-241
29. Franken N., and Engelbrecht A.P. Particle swarm optimization approaches to coevolve strategies for the iterated prisoner's dilemma. IEEE Trans. Evol. Comput. 9 6 (2005) 562-579
30. Frayn, C. M. 2005. An evolutionary approach to strategies for the game of Monopoly. In: Kendall, G., Lucas, S.M. (Chairs), Proceedings of the 2005 IEEE Symposium on Computational Intelligence and Games. IEEE Press, Piscataway, NJ, pp. 66-72.
31. Gallagher M., and Ryan A. Learning to play Pac-man: an evolutionary, rule-based approach. Proceedings of the 2003 Congress on Evolutionary Computation (2003), IEEE Press, Piscataway, NJ 2462-2469
32. Grand S. Creation: Life and How to Make It (2001), Harvard University Press, Cambridge, MA
33. Harrald P.G., and Fogel D.B. Evolving continuous behaviors in the iterated prisoner's dilemma. Biosystems 37 (1996) 135-145
34. Hong, J.-H., Cho, S.-B., 2005. Evolving reactive NPCs for the real-time simulation game. In: Kendall, G., Lucas, S.M. (Chairs), Proceedings of the 2005 IEEE Symposium on Computational Intelligence and Games. IEEE Press, Piscataway, NJ, pp. 86-93.
35. Hughes E.J. Piece difference: simple to evolve?. Proceedings of the 2003 Congress on Evolutionary Computation (2003), IEEE Press, Piscataway, NJ 2470-2473
36. Hughes E.J. Checkers using a co-evolutionary on-line evolutionary algorithm. Proceedings of the 2005 IEEE Congress on Evolutionary Computation (2005), IEEE Press, Piscataway, NJ 1899-1905
37. Ishibuchi H., and Namikawa N. Evolution of iterated prisoner's dilemma game strategies in structured demes under random pairing in game playing. IEEE Trans. Evol. Comput. 9 6 (2005) 552-561
38. Kendall, G., Lucas, S.M. (Chairs), 2005. Proceedings of the 2005 IEEE Symposium on Computational Intelligence and Games. IEEE Press, Piscataway, NJ.
39. Kendall G., and Smith C. The evolution of blackjack strategies. Proceedings of the 2003 Congress on Evolutionary Computation (2003), IEEE Press, Piscataway, NJ 2474-2481
40. Kendall G., and Whitwell G. An evolutionary approach for the tuning of a chess evaluation function using population dynamics. Proceedings of the 2001 Congress on Evolutionary Computation (2001), IEEE Press, Piscataway, NJ 995-1002
41. Kendall G., Yaakob R., and Hingston P. An investigation of an evolutionary approach of the opening of Go. Proceedings of the 2004 Congress on Evolutionary Computation (2004), IEEE Press, Piscataway, NJ 97-108
42. Kim K.-J., and Cho S.-B. Evolving speciated checkers players with crowding algorithm. Proceedings of the 2002 Congress on Evolutionary Computation (2003), IEEE Press, Piscataway, NJ 407-412
43. Kim K.-J., and Cho S.-B. Systematically incorporating domain-specific knowledge into evolutionary speciated checkers players. IEEE Trans. Evol. Comput. 9 6 (2005) 615-627
44. Loftos, T., 2003. MSNBC, http://www.msnbc.com/news/924871.asp?0cv=CB2, June 17.
45. Louis S.J., and Miles C. Playing to learn: case-injected genetic algorithms for learning to play computer games. IEEE Trans. Evol. Comput. 9 6 (2005) 669-681
46. Lubberts A., and Miikkulainen R. Co-evolving a go-playing neural network. Proceedings of the Genetic and Evolutionary Computation Conference Workshop (2001) 1226-1238
47. Lucas, S.M., 2005. Evolving a neural network location evaluator to play Ms. Pac-Man. In: Kendall, G., Lucas, S.M. (Chairs), Proceedings of the 2005 IEEE Symposium on Computational Intelligence and Games. IEEE Press, Piscataway, NJ, pp. 203-210.
48. Luke S. Genetic programming produced competitive soccer softbot teams for robocup97. In: Koza J.R., Banzhaf W., Chellapilla K., Deb K., Dorigo M., Fogel D.B., and Garzon M.H. (Eds). Genetic Programming (1998), Morgan Kaufmann, San Francisco, CA 214-222
49. Moriarty D.E., and Miikkulainen R. Discovering complex Othello strategies through evolutionary neural networks. Connection Sci. 7 (1995) 195-209
50. Nakamoto, R., 2001. Personal communication.
51. Parker G.B., Doherty T., and Parker M. Evolution and prioritization of survival strategies for a simulated robot in Xpilot. Proceedings of the 2005 IEEE Congress on Evolutionary Computation (2005), IEEE Press, Piscataway, NJ 2410-2415
52. Pollack J.B., and Blair A.D. Co-evolution in the successful learning of backgammon strategy. Mach. Learn. 32 3 (1998) 225-240
53. Porto V.W., Hardt M., Fogel D.B., Kreutz-Delgado K., and Fogel L.J. Evolving tactics in computer-generated forces. In: Sisti A. (Ed). AeroSense99 Symposium for Enabling Technologoy for Simulation Science III (1999), SPIE, Bellingham, WA
54. Reed J., Toombs R., and Barricelli N.A. Simulation of biological evolution and machine learning. I. Selection of self-reproducing numeric patterns by data processing machines, effects of hereditary control, mutation type and crossing. J. Theor. Biol. 17 (1967) 317-342
55. Richards N., Moriarty D., and Miikkulainen R. Evolving neural networks to play go. Appl. Intell. 8 (1998) 85-96
56. Runnarson T., and Lucas S.M. Coevolution versus self-play temporal difference learning for acquiring position evaluation in small-board go. IEEE Trans. Evol. Comput. 9 6 (2005) 628-640
57. Samuel A. Some studies in machine learning using the game of checkers. IBM J. Res. Dev. 3 (1959) 211-229
58. Stanley K.O., Bryant B.D., and Miikkulainen R. Real-time neuroevolution in the NERO video game. IEEE Trans. Evol. Comput. 9 6 (2005) 653-668
59. Tanev I., Joachimczak J., Hemmi H., and Shimohara K. Evolution of the driving styles of anticipatory agent remotely operating a scaled model of racing car. Proceedings of the 2005 IEEE Congress on Evolutionary Computation (2005), IEEE Press, Piscataway, NJ 1891-1898
60. Togelius J., and Lucas S. Evolving controllers for simulated car racing. Proceedings of the 2005 IEEE Congress on Evolutionary Computation (2005), IEEE Press, Piscataway, NJ 1906-1913
61. Vaccaro J.M., and Guest C.G. Planning an endgame move set for the game RISK: a comparison of search algorithms. IEEE Trans. Evol. Comput. 9 6 (2005) 641-652