Real-time evolution of neural networks in the NERO video game

Proceedings of the National Conference on Artificial Intelligence

Volumn 2, Issue , 2006, Pages 1671-1674

  Stanley, Kenneth O ^a,b   Bryant, Bobby D ^c   Karpov, Igor ^c   Miikkulalnen, Risto ^c  

^a University of Central Florida   (United States)

^b University of Texas at Austin   (United States)

^c NONE

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; INTERACTIVE COMPUTER GRAPHICS; LEARNING SYSTEMS; NEURAL NETWORKS; REAL TIME SYSTEMS;

DIGITAL ENTERTAINMENT; INTERACTIVE SIMULATIONS; REAL TIME EVOLUTION; VIDEO GAME;

ANIMATION;

EID: 33750712018     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. Agre, P. E., and Chapman, D. 1987. Pengi: An implementation of a theory of activity. In Proceedings AAAI-87 Sixth National Conference on Artificial Intelligence, volume 1, 268-272. Los Altos, CA: Morgan Kaufmann.
2. Cole, N.; Louis, S.; and Miles, C. 2004. Using a genetic algorithm to tune first-person shooter bots. In Evolutionary Computation, 2004. CEC2004. Congress on Evolutionary Computation, volume 1, 139-145. Piscataway, NJ: IEEE.
3. Fogel, D. B.; Hays, T. J.; and Johnson, D. R. 2004. A platform for evolving characters in competitive games. In Proceedings of 2004 Congress on Evolutionary Computation, 1420-1426. Piscataway, NJ: IEEE Press.
4. Geisler, B. 2002. An empirical study of machine learning algorithms applied to modeling player behavior in a 'first person shooter' video game. Master's thesis, Department of Computer Sciences, University of Wisconsin-Madison, Madison, WI.
5. Gomez, F., and Miikkulainen, R. 1999. Solving non-Markovian control tasks with neuroevolution. In Proceedings of the 16th International Joint Conference on Artificial Intelligence, 1356-1361. San Francisco: Kaufmann.
6. Gruau, F.; Whitley, D.; and Pyeatt, L. 1996. A comparison between cellular encoding and direct encoding for genetic neural networks. In Koza, J. R.; Goldberg, D. E.; Fogel, D. B.; and Riolo, R. L., eds., Genetic Programming 1996: Proceedings of the First Annual Conference, 81-89. Cambridge, MA: MIT Press.
7. Hong, J.-H., and Cho, S.-B. 2004. Evolution of emergent behaviors for shooting game characters in robocode. In Evolutionary Computation, 2004. CEC2004. Congress on Evolutionary Computation, volume 1, 634-638. Piscataway, NJ: IEEE.
8. Laird, J. E., and van Lent, M. 2000. Human-level AI's killer application: Interactive computer games. In Proceedings of the 17th National Conference on Artificial Intelligence and the 12th Annual Conference on Innovative Applications of Artificial Intelligence. Menlo Park, CA: AAAI Press.
9. Maudlin, M. L.; Jacobson, G.; Appel, A.; and Hamey, L. 1984. ROG-O-MATIC: A belligerent expert system. In Proceedings of the Fifth National Conference of the Canadian Society for Computational Studies of Intelligence (CSCSI-84).
10. Opitz, D. W., and Shavlik, J. W. 1997. Connectionist theory refinement: Genetically searching the space of network topologies. Journal of Artificial Intelligence Research 6:177-209.
11. Radcliffe, N. J. 1993. Genetic set recombination and its application to neural network topology optimization. Neural computing and applications 1(1):67-90.
12. Saravanan, N., and Fogel, D. B. 1995. Evolving neural control systems. IEEE Expert 23-27.
13. Stanley, K. O., and Miikkulainen, R. 2002. Evolving neural networks through augmenting topologies. Evolutionary Computation 10:99-127.
14. Stanley, K. O., and Miikkulainen, R. 2004. Competitive coevolution through evolutionary complexification. Journal of Artificial Intelligence Research 21:63-100.
15. Stanley, K. O.; Bryant, B.; and Miikkulainen, R. 2005a. Real-time neuroevolution in the NERO video game. IEEE Transactions on Evolutionary Computation 9:653-668.
16. Stanley, K. O.; Bryant, B. D.; and Miikkulainen, R. 2005b. Evolving neural network agents in the NERO video game. IEEE Symposium on Computational Intelligence and Games.
17. Stanley, K. O.; Kohl, N.; and Miikkulainen, R. 2005. Neuroevolution of an automobile crash warning system. In Proceedings of the Genetic and Evolutionary Computation Conference.
18. Sutton, R. S., and Barto, A. G. 1998. Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press.
19. Wieland, A. 1991. Evolving neural network controllers for unstable systems. In Proceedings of the International Joint Conference on Neural Networks (Seattle, WA), 667-673. Piscataway, NJ: IEEE.
20. Yao, X. 1999. Evolving artificial neural networks. Proceedings of the IEEE 87(9):1423-1447.
21. Zhang, B.-T., and Muhlenbein, H. 1993. Evolving optimal neural networks using genetic algorithms with Occam's razor. Complex Systems 7:199-220.