Autonomous evolution of topographic regularities in artificial neural networks

Neural Computation

Volumn 22, Issue 7, 2010, Pages 1860-1898

  Gauci, Jason ^a   Stanley, Kenneth O ^a  

^a University of Central Florida   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; COMPUTER SIMULATION; EVOLUTION; HUMAN; LETTER; NERVE CELL; NERVE CELL NETWORK; PHYSIOLOGY;

ANIMALS; ARTIFICIAL INTELLIGENCE; BIOLOGICAL EVOLUTION; COMPUTER SIMULATION; HUMANS; NERVE NET; NEURAL NETWORKS (COMPUTER); NEURONS;

EID: 77955992290     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/neco.2010.06-09-1042     Document Type: Letter

References (97)

1. Aaltonen, T., Adelman, J., Akimoto, T., Albrow, M. G., Alvarez Gonzalez, B., Almerio, S., et al. (2009). Measurement of the top quark mass with dilepton events selected using neuroevolution at CDF. Physical Review Letters, 102, 152001-152008.
2. Altenberg, L. (1994). Evolving better representations through selective genome growth. In Proceedings of the IEEE World Congress on Computational Intelligence (pp. 182-187). Piscataway, NJ: IEEE Press.
3. Andrade, M. A., Muro, E. M., & Morán, F. (2001). Simulation of plasticity in the adult visual cortex. Biological Cybernetics, 84(6), 445-451.
4. Angeline, P. J., Saunders, G. M., & Pollack, J. B. (1993). An evolutionary algorithm that constructs recurrent neural networks. IEEE Transactions on Neural Networks, 5, 54-65.
5. Astor, J. S., & Adami, C. (2000). A developmental model for the evolution of artificial neural networks. Artificial Life, 6(3), 189-218.
6. Bednar, J. A., Kelkar, A., & Miikkulainen, R. (2002). Modeling large cortical networks with growing self-organizing maps. Neurocomputing, 44-46, 315-321.
7. Bednar, J. A., & Miikkulainen, R. (2006). Joint maps for orientation, eye, and direction preference in a self-organizing model of V1. Neurocomputing, 69(10-12), 1272-1276.
8. Beer, R. D. (2000). Dynamical approaches to cognitive science. Trends in Cognitive Sciences, 4, 91-99.
9. Beer, R., & Gallagher, J. (1992). Evolving dynamical neural networks for adaptive behavior. Adaptive Behavior, 1(1), 91.
10. Bentley, P. J., & Kumar, S. (1999). The ways to grow designs: A comparison of embryogenies for an evolutionary design problem. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-1999) (pp. 35-43). San Francisco: Morgan Kaufmann.
11. Bongard, J. C. (2002). Evolving modular genetic regulatory networks. In Proceedings of the 2002 Congress on Evolutionary Computation. San Mateo, CA: IEEE Computer Society.
12. Braun, H., & Weisbrod, J. (1993). Evolving feedforward neural networks. In Proceedings of ANNGA93, International Conference on Artificial Neural Networks and Genetic Algorithms. Berlin: Springer.
13. Chellapilla, K., & Fogel, D. B. (2001). Evolving an expert checkers playing program without using human expertise. IEEE Trans. Evolutionary Computation, 5(4), 422-428.
14. Chklovskii, D. B., & Koulakov, A. A. (2004). Maps in the brain: What can we learn from them? Annual Review of Neuroscience, 27, 369-392.
15. Choe, Y., & Miikkulainen, R. (2004). Contour integration and segmentation in a self-organizing map of spiking neurons. Biological Cybernetics, 90, 75-88.
16. Churchland, P. M. (1986). Some reductive strategies in cognitive neurobiology. Mind, 95, 279-309.
17. Clune, J., Beckmann, B., Ofria, C., & Pennock, R. (2009). Evolving coordinated quadruped gaits with the hyperneat generative encoding. In IEEE Congress on Evolutionary Computation. Piscataway, NJ: IEEE Press.
18. Clune, J., Ofria, C., & Pennock, R. T. (2008). How a generative encoding fares as problem-regularity decreases. In Proceedings of the 10th International Conference on Parallel Problem Solving from Nature (pp. 358-367). Berlin: Springer-Verlag.
19. Clune, J., Ofria, C., & Pennock, R. (2009). The sensitivity of hyperneat to different geometric representations of a problem. In Proceedings of the 11th Annual Conference on Genetic and Evolutionary Computation (pp. 675-682). New York: ACM.
20. D'Ambrosio, D., & Stanley, K. O. (2007). A novel generative encoding for exploiting neural network sensor and output geometry. In Proceedings of the Genetic and Evolutionary Computation Conference. New York: ACM Press.
21. D'Ambrosio, D. B., & Stanley, K. O. (2008). Generative encoding for multiagent learning. In Proceedings of the Genetic and Evolutionary Computation Conference. New York: ACM Press.
22. Dellaert, F., & Beer, R. D. (1994). Co-evolving body and brain in autonomous agents using a developmental model (Tech. Rep. CES-94-16). Cleveland, OH: Department of Computer Engineering and Science, Case Western Reserve University.
23. Eggenberger, P. (1997). Evolving morphologies of simulated 3D organisms based on differential gene expression. In P. Husbands & I. Harvey (Eds.), Proceedings of the Fourth European Conference on Artificial Life (pp. 205-213). Cambridge, MA: MIT Press.
24. Fierz, M. (2002). Xcheckers, Cliche, and GPL-Cake. Available online at Simplech: http://arton.cunst.net/xcheckers/.
25. Floreano, D., Dürr, P., & Mattiussi, C. (2008). Neuroevolution: From architectures to learning. Evolutionary Intelligence, 1(1), 47-62.
26. Floreano, D., & Mondada, F. (1996). Evolution of plastic neurocontrollers for situated agents. IEEE Transactions on Systems, Man, and Cybernetics, 26(3), 396-407.
27. Floreano, D., & Urzelai, J. (2000). Evolutionary robots with online self-organization and behavioral fitness. Neural Networks, 13, 431-443.
28. Floreano, D., & Urzelai, J. (2001). Evolution of plastic control networks. Autonomous Robots, 11(3), 311-317.
29. Fogel, D. (1992). Evolving artificial intelligence. Unpublished doctoral dissertation, University of California, San Diego.
30. Fogel, D. (1993). Using evolutionary programing to create neural networks that are capable of playing tic-tac-toe. In IEEE International Conference on Neural Networks, 1993 (pp. 875-880). Piscataway, NJ: IEEE.
31. Fogel, D. B. (2002). Blondie24: Playing at the edge of AI. San Francisco: Morgan Kaufmann.
32. Fogel, D., Fogel, L., & Porto, V. (1990). Evolving neural networks. Biological Cybernetics, 63(6), 487-493.
33. Fogel, D., Hays, T., Hahn, S., & Quon, J. (2004). A self-learning evolutionary chess program. Proceedings of the IEEE, 92(12), 1947-1954.
34. Gauci, J., & Stanley, K. O. (2007). Generating large-scale neural networks through discovering geometric regularities. In Proceedings of the Genetic and Evolutionary Computation Conference. New York: ACM Press.
35. Gomez, F., & Miikkulainen, R. (1997). Incremental evolution of complex general behavior. Adaptive Behavior, 5, 317-342.
36. Gomez, F., Schmidhuber, J., & Miikkulainen, R. (2008). Accelerated neural evolution through cooperatively coevolved synapses. J. Mach. Learn. Res., 9, 937-965.
37. Goodhill, G. J., & Carreira-Perpinn, M. A. (2002). Cortical columns. In L. Nadel (Ed.), Encyclopedia of cognitive science (vol. 1, pp. 845-851). New York: Macmillan.
38. Gruau, F. (1995). Automatic definition of modular neural networks. Adaptive Behaviour, 3(2), 151-183.
39. Gruau, F., Whitley, D., & Pyeatt, L. (1996). A comparison between cellular encoding and direct encoding for genetic neural networks. In J. R. Koza, D. E. Goldberg, D. B. Fogel, & R. L. Riolo (Eds.), Genetic programming 1996: Proceedings of the First Annual Conference (pp. 81-89). Cambridge, MA: MIT Press.
40. Harp, S. A., Samad, T., & Guha, A. (1989). Towards the genetic synthesis of neural network. In Proceedings of the Third International Conference on Genetic Algorithms (pp. 360-369). San Francisco: Morgan Kaufmann.
41. Hornby, G. (2004). Shortcomings with tree-structured edge encodings for neural networks. In Proceedings of the Genetic and Evolutionary Computation Conference. Berlin: Springer-Verlag.
42. Hornby, G. S., & Pollack, J. B. (2001). The advantages of generative grammatical encodings for physical design. In Proceedings of the 2002 Congress on Evolutionary Computation. Piscataway, NJ: IEEE Press.
43. Hornby, G. S., & Pollack, J. B. (2002). Creating high-level components with a generative representation for body-brain evolution. Artificial Life, 8(3), 600-607.
44. Hubel, D. H. (1988). Eye, brain, and vision. New York: Freeman.
45. Hubel, D. H., & Wiesel, T. N. (1962). Receptive fields, binocular interaction and functional architecture in the cat's visual cortex. Journal of Physiology, 160, 106-154.
46. Hubel, D. H., & Wiesel, T. N. (1968). Receptive fields and functional architecture of monkey striate cortex. Journal of Physiology, 195, 215-243.
47. Hubel, D. H., Wiesel, T. N., & LeVay, S. (1977). Plasticity of ocular dominance columns in monkey striate cortex. Philosophical Transactions of the Royal Society of London, Series B, Biological Sciences, 278, 377-409.
48. Husbands, P., Smith, T., Jakobi, N., & Shea, M. (1998). Better living through chemistry: Evolving GasNets for robot control. Connection Science, 10(3), 185-210.
49. Kampfner, R., & Conrad, M. (1983). Computational modeling of evolutionary learning processes in the brain. Bulletin of Mathematical Biology, 45(6), 931-968.
50. Kandel, E. R., Schwartz, J. H., & Jessell, T. M. (2000). Principles of neural science (4th ed.). New York: McGraw-Hill.
51. Kitano, H. (1990). Designing neural networks using genetic algorithms with graph generation system. Complex Systems, 4, 461-476.
52. Knuth, D., & Moore, R. (1975). An analysis of alpha-beta pruning. Artificial Intelligence, 6(4), 293-326.
53. Kohonen, T. (1981). Automatic formation of topological maps of patterns in a self-organizing system. In Proceedings of the 2nd Scandinavian Conference on Image Analysis (pp. 214-220). Espoo, Finland: Pattern Recognition Society of Finland.
54. Komosinski, M., & Rotaru-Varga, A. (2001). Comparison of different genotype encodings for simulated 3D agents. Artificial Life, 7(4), 395-418.
55. Koza, J. R., & Rice, J. P. (1991). Genetic generation of both the weights and architecture for a neural network. In International Joint Conference on Neural Networks (pp. 397-404). Piscataway, NJ: IEEE.
56. Leuba, G., & Kraftsik, R. (1994). Changes in volume, surface estimate, three-dimensional shape and total number of neurons of the human primary visual cortex from midgestation until old age. Berlin: Springer.
57. Lindenmayer, A. (1974). Adding continuous components to L-systems. In G. Rozenberg & A. Salomaa (Eds.), L Systems. Berlin: Springer-Verlag.
58. Lipson, H., & Pollack, J. B. (2000). Automatic design and manufacture of robotic lifeforms. Nature, 406, 974-978.
59. Mattiussi, C., & Floreano, D. (2007). Analog genetic encoding for the evolution of circuits and networks. IEEE Transactions on Evolutionary Computation, 11(5), 596-607.
60. McClelland, J. L., Rumelhart, D. E., & Hinton, G. E. (1986). The appeal of parallel distributed processing. In D. E. Rumelhart & J. L. McClelland (Eds.), Parallel distributed processing: Explorations in the microstructure of cognition (Vol. 1, foundations, pp. 3-44). Cambridge, MA: MIT Press.
61. McHale, G., & Husbands, P. (2004). Quadrupedal locomotion: GasNets, CTRNNs and hybrid CTRNN/PNNs compared. In Artificial life IX: Proceedings of the Ninth International Conference on the Simulation and Synthesis of Artificial Life (p. 106). Cambridge, MA: MIT Press.
62. Miikkulainen, R., Bednar, J. A., Choe, Y., & Sirosh, J. (2005). Computational maps in the visual cortex. Berlin: Springer.
63. Miikkulainen, R., & Dyer, M. G. (1989). Encoding input/output representations in connectionist cognitive systems. In D. S. Touretzky, G. E. Hinton, & T. J. Sejnowski (Eds.), Proceedings of the 1988 Connectionist Models Summer School (pp. 347-356). San Francisco: Morgan Kaufmann.
64. Miller, G. F., Todd, P. M., & Hegde, S. U. (1989). Designing neural networks using genetic algorithms. In Proceedings of the Third International Conference on Genetic Algorithms (pp. 379-384). San Francisco: Morgan Kaufmann.
65. Montana, D. J., & Davis, L. (1989). Training feedforward neural networks using genetic algorithms. In Proceedings of the 11th International Joint Conference on Artificial Intelligence (pp. 762-767). San Francisco: Morgan Kaufmann.
66. Moriarty, D. E., & Miikkulainen, R. (1996). Efficient reinforcement learning through symbiotic evolution. In L. P. Kaelbling (Ed.), Recent advances in reinforcement learning. Dordrecht: Kluwer.
67. Nakamura, A., Yamada, T., Goto, A., Kato, T., Ito, K., Abe, Y., et al. (1998). Somatosensory homunculus as drawn by MEG. Neuroimage, 7(4), 377-386.
68. Opitz, D. W., & Shavlik, J. W. (1997). Connectionist theory refinement: Genetically searching the space of network topologies. Journal of Artificial Intelligence Research, 6, 177-209.
69. Pujol, J. C. F., & Poli, R. (1998). Evolving the topology and the weights of neural networks using a dual representation. Applied Intelligence Journal, 8(1), 73-84.
70. Risi, S., Vanderbleek, S. D., Hughes, C. E., & Stanley, K. O. (2009). How novelty search escapes the deceptive trap of learning to learn. In Proceedings of the Genetic and Evolutionary Computation Conference. New York: ACM Press.
71. Rosen, Y., & Lenkinski, R. E. (2007). Recent advances in magnetic resonance neurospectroscopy. Neurotherapeutics, 330-345.
72. Russell, S., Norvig, P., Canny, J., Malik, J., & Edwards, D. (1995). Artificial intelligence: A modern approach. Englewood Cliffs, NJ: Prentice Hall.
73. Sims, K. (1994). Evolving 3D morphology and behavior by competition. In R. A. Brooks & P. Maes (Eds.), Proceedings of the Fourth International Workshop on the Synthesis and Simulation of Living Systems (Artificial Life IV) (pp. 28-39). Cambridge, MA: MIT Press.
74. Soltoggio, A., Bullinaria, J. A., Mattiussi, C., Dürr, P., & Floreano, D. (2008). Evolutionary advantages of neuromodulated plasticity in dynamic, reward-based scenarios. Artificial Life, 11, pp. 569-576.
75. Sporns, O. (2002). Network analysis, complexity, and brain function. Complexity, 8(1), 56-60.
76. Srinivas, M., & Paranaik, L. (1991). Learning neural network weights using genetic algorithms-improving performance by search-space reduction. IEEE International Joint Conference on Neural Networks, 3, 2331-2336.
77. Stanley, K. O. (2007). Compositional pattern producing networks: A novel abstraction of development. Genetic Programming and Evolvable Machines, 8, 131-162.
78. Stanley, K. O., Bryant, B. D., & Miikkulainen, R. (2005a). Evolving neural network agents in the NERO video game. In Proceedings of the IEEE 2005 Symposium on Computational Intelligence and Games. Piscataway, NJ: IEEE.
79. Stanley, K. O., Bryant, B. D., & Miikkulainen, R. (2005b). Real-time neuroevolution in the NERO video game. IEEE Transactions on Evolutionary Computation Special Issue on Evolutionary Computation and Games, 9(6), 653-668.
80. Stanley, K. O., D'Ambrosio, D. B., & Gauci, J. (2009). A hypercube-based encoding for evolving large-scale neural networks. Artificial Life, 15, 185-212.
81. Stanley, K. O., Kohl, N., & Miikkulainen, R. (2005). Neuroevolution of an automobile crash warning system. In Proceedings of the Genetic and Evolutionary Computation Conference. New York: ACM.
82. Stanley, K. O., & Miikkulainen, R. (2002a). Efficient evolution of neural network topologies. In Proceedings of the 2002 Congress on Evolutionary Computation. Piscataway, NJ: IEEE.
83. Stanley, K. O., & Miikkulainen, R. (2002b). Efficient reinforcement learning through evolving neural network topologies. In Proceedings of the Genetic and Evolutionary Computation Conference. San Francisco: Morgan Kaufmann.
84. Stanley, K. O., & Miikkulainen, R. (2002c). Evolving neural networks through augmenting topologies. Evolutionary Computation, 10, 99-127.
85. Stanley, K. O., & Miikkulainen, R. (2003). A taxonomy for artificial embryogeny. Artificial Life, 9(2), 93-130.
86. Stanley, K. O., & Miikkulainen, R. (2004). Competitive coevolution through evolutionary complexification. Journal of Artificial Intelligence Research, 21, 63-100.
87. Swindale, N. V. (1996). The development of topography in the visual cortex: A review of models. Network: Computation in Neural Systems, 7, 161-247.
88. Taylor, M. E., Whiteson, S., & Stone, P. (2006). Comparing evolutionary and temporal difference methods in a reinforcement learning domain. In GECCO 2006: Proceedings of the Genetic and Evolutionary Computation Conference (pp. 1321-1328). New York: ACM.
89. Togelius, J., & Lucas, S. M. (2005). Forcing neurocontrollers to exploit sensory symmetry through hard-wired modularity in the game of cellz. In Proceedings of the IEEE Symposium on Computational Intelligence and Games (pp. 37-43). Piscataway, NJ: IEEE.
90. Turing, A. (1952). The chemical basis of morphogenesis. Philosophical Transactions of the Royal Society B, 237, 37-72.
91. Weliky, M., Bosking, W. H., & Fitzpatrick, D. (1996). A systematic map of direction preference in primary visual cortex. Nature, 379, 725-728.
92. Whiteson, S., Kohl, N., Miikkulainen, R., & Stone, P. (2003). Evolving RoboCup keepaway players through task decomposition. In Proceedings of the Genetic and Evolutionary Computation Conference (pp. 356-368). San Francisco: Morgan Kaufmann.
93. Whitley, D. (1995). Genetic algorithms and neural networks. In J. Periaux, M. Galan, & P. Cuesta (Eds.), Genetic algorithms in engineering and computer science (pp. 203-216). Hoboken, NJ: Wiley.
94. Wieland, A. (1991). Evolving neural network controllers for unstable systems. In Proceedings of the International Joint Conference on Neural Networks (pp. 667-673). Piscataway, NJ: IEEE.
95. Yang, T., Gallen, C., Schwartz, B., & Bloom, F. (1993). Noninvasive somatosensory homunculus mapping in humans by using a large-array biomagnetometer. Proceedings of the National Academy of Sciences, 90(7), 3098-3102.
96. Yao, X. (1999). Evolving artificial neural networks. Proceedings of the IEEE, 87(9), 1423-1447.
97. Zhang, B.-T., & Muhlenbein, H. (1993). Evolving optimal neural networks using genetic algorithms with Occam's razor. Complex Systems, 7, 199-220.