Understanding the emergence of modularity in neural systems

Cognitive Science

Volumn 31, Issue 4, 2007, Pages 673-695

  Bullinaria, John A ^a  

^a UNIVERSITY OF BIRMINGHAM   (United Kingdom)

Author keywords

Computational modeling; Evolution; Learning; Modularity; Neural systems

Indexed keywords

EID: 34547963885     PISSN: 03640213     EISSN: None     Source Type: Journal    
DOI: 10.1080/15326900701399939     Document Type: Article

References (68)

1. Anand, R., Mehrotra, K., Mohan, C. K., & Ranka, S. (1995). Efficient classification for multiclass problems using modular neural networks. IEEE Transactions on Neural Networks, 6, 117-124.
2. Baldwin, J. M. (1896). A new factor in evolution. The American Naturalist, 30, 441-451.
3. Ballard, D. H. (1986). Cortical connections and parallel processing: Structure and function. Behavioral and Brain Sciences, 9, 67-120.
4. Belew, R. K., & Mitchell, M. (Eds.). (1996). Adaptive individuals in evolving populations. Reading, NM: Addison-Wesley.
5. Bishop, C. M. (1995). Neural networks for pattern recognition. Oxford, UK: Oxford University Press.
6. Bookheimer, S. (2002). Functional MRI of language: New approaches to understanding the cortical organization of semantic processing. Annual Review of Neuroscience, 25, 151-188.
7. Bowers, C. P., & Bullinaria, J. A. (2005). Embryological modeling of the evolution of neural architecture. In A. Cangelosi, G. Bugmann, & R. Borisyuk (Eds.), Modeling language, cognition and action, 375-384. Singapore: World Scientific.
8. Bullinaria, J. A. (1997). Analysing the internal representations of trained neural networks. In A. Browne (Ed.), Neural network analysis, architectures and applications, 3-26. Bristol, UK: Institute of Physics.
9. Bullinaria, J. A. (2001). Simulating the evolution of modular neural systems. In Proceedings of the Twenty-third Annual Conference of the Cognitive Science Society, 146-151. Mahwah, NJ: Lawrence Erlbaum.
10. Bullinaria, J. A. (2002). The evolution of gated sub-networks and modularity in the human brain. In J. A. Bullinaria & W. Lowe (Eds.), Connectionist models of cognition and perception, 27-39. Singapore: World Scientific.
11. Bullinaria, J. A. (2003a). Evolving efficient learning algorithms for binary mappings. Neural Networks, 16, 793-800.
12. Bullinaria, J. A. (2003b). From biological models to the evolution of robot control systems. Philosophical Transactions of the Royal Society of London A, 361, 2145-2164.
13. Bullinaria, J. A. (2004). Generational versus steady-state evolution for optimizing neural network learning. In Proceedings of the International Joint Conference on Neural Networks (IJCNN 2004), (pp. 2297-2302). Piscataway, NJ: IEEE.
14. Bullinaria, J. A. (2005). Connectionist neuropsychology. In G. Houghton (Ed.), Connectionist models in cognitive psychology, (pp 83-111). Brighton, UK: Psychology Press.
15. Bullinaria, J. A., & Chater N. (1995). Connectionist modelling: Implications for cognitive neuropsychology. Language and Cognitive Processes, 10, 227-264.
16. Calabretta, R., Di Ferinando, A., Wagner, G. P., & Parisi, D. (2003). What does it take to evolve behaviorally complex organisms? BioSystems, 69, 245-262.
17. Cantǔ-Paz, E., & Kamath, C. (2005). An empirical comparison of combinations of evolutionary algorithms and neural networks for classification problems. IEEE Transactions on Systems, Man, and Cybernetics-Part B: Cybernetics, 35, 915-927.
18. Caramazza, A. (1986). On drawing inferences about the structure of normal cognitive systems from analysis of patterns of impaired performance: The case of single-patient studies. Brain and Cognition, 5, 41-66.
19. Chang, F. (2002). Symbolically speaking: A connectionist model of sentence production, Cognitive Science, 26, 609-651.
20. Changizi, M. A. (2001). Principles underlying mammalian neocortical scaling. Biological Cybernetics, 84, 207-215.
21. Chklovskii, D. B. (2004). Exact solution for the optimal neuronal layout problem. Neural Computation, 16, 2067-2078.
22. Chklovskii, D. B., Schikorski, T., & Stevens, C. F. (2002). Wiring optimization in cortical circuits. Neuron, 34, 341-347.
23. Devlin, J. T., Gonnerman, L. M., Andersen, E. S., & Seidenberg, M. S. (1998). Category-specific semantic deficits in focal and widespread brain damage: A computational account. Journal of Cognitive Neuroscience, 10, 77-94.
24. Di Ferdinando, A., Calabretta, R., & Parisi. D. (2001). Evolving modular architectures for neural networks. In R. F. French, & J. P. Sougne (Eds.),Connectionist Models of Learning, Development, and Evolution, 253-262. London: Springer-Verlag.
25. Dunn, J. C., & Kirsner, K. (1988). Discovering functionally independent mental processes: The principle of reversed association. Psychological Review, 95, 91-101.
26. Ebbesson, S. O. E. (1984). Evolution and ontogeny of neural circuits. Behavioral and Brain Sciences, 7, 321-366.
27. Elman, J. L., Bates, E. A., Johnson, M. H., Karmiloff-Smith, A., Parisi, D., & Plunkett, K. (1996). Rethinking innateness: A connectionist perspective on development. Cambridge, MA: MIT Press.
28. Fahlman, S. E. (1988). Faster learning variations of back propagation: An empirical study. In D. Touretzky, G. E. Hinton, & T. J. Sejnowski (Eds.). Proceedings of the 1988 Connectionist Models Summer School, (pp. 38-51). San Mateo, CA: Morgan Kaufmann.
29. Fodor, J. A. (1983). The modularity of the mind. Cambridge, MA: MIT Press.
30. Geary, D. C., & Huffman, K. J. (2002). Brain and cognitive evolution: Forms of modularity and functions of mind. Psychological Bulletin, 128, 667-698.
31. Glover, S. (2004). Separate visual representations in the planning and control of action. Behavioral and Brain Sciences, 27, 3-24.
32. Goodale, M. A., & Milner, A. (1992). Separate visual pathways for perception and action. Trends in Neuroscience, 15, 20-25.
33. Hinton, G. E. (1989). Connectionist learning procedures. Artificial Intelligence, 40, 185-234.
34. Hinton, G. E., & Nowlan, S. J. (1987). How learning can guide evolution. Complex Systems, 1, 495-502.
35. Hüsken, M., Igel, C., & Toussaint, M. (2002). Task-dependent evolution of modularity in neural networks. Connection Science, 14, 219-229.
36. Huettel, S. A., Song, A. W., & McCarthy, G. (2004). Functional magnetic resonance imaging. Sunderland, MA: Sinauer Associates Incorporated.
37. Jacobs, R. A. (1999). Computational studies of the development of functionally specialized neural modules. Trends in Cognitive Sciences, 3, 31-38.
38. Jacobs, R. A., & Jordan, M. I. (1992). Computational consequences of a bias toward short connections. Journal of Cognitive Neuroscience, 4, 323-336.
39. Jacobs, R. A., Jordan, M. I., & Barto, A. G. (1991). Task decomposition through competition in modular connectionist architecture: The what and where vision tasks. Cognitive Science, 15, 219-250.
40. Jeannerod, M. (1997). The cognitive neuroscience of action. Oxford, UK: Blackwell.
41. Kaas, J. H. (2000). Why is brain size so important: Design problems and solutions as neo-cortex gets bigger or smaller. Brain and Mind, 1, 7-23.
42. Karbowski, J. (2003). How does connectivity between cortical areas depend on brain size? Implications for efficient computation. Journal of Computational Neuroscience, 15, 347-356.
43. Kashtan, N., & Alon, U. (2005). Spontaneous evolution of modularity and network motifs. Proceedings of the National Academy of Sciences, 12, 13773-13778.
44. Lipson, H., Pollack, J. B., & Suh, N.,P, (2002). On the origin of modular variation. Evolution, 56, 1549-1556.
45. Marcus, G. (2004). The birth of the mind. New York: Basic Books.
46. Milner, A. D., & Goodale, M. A. (1995). The visual brain in action. Oxford, UK: Oxford University Press.
47. Mishkin, M., Ungerleider, L. G., & Macko, K. A. (1983). Object vision and spatial vision: Two cortical pathways. Trends in Neurosciences, 6, 414-417.
48. O'Leary, D. D. M. (1989). Do cortical areas emerge from a protocortex? Trends in Neurosciences, 12, 400-406.
49. Plaut, D. C. (1995). Double dissociation without modularity: Evidence from connectionist neuropsychology. Journal of Clinical and Experimental Neuropsychology, 17, 291-321.
50. Plaut, D. C. (2002). Graded modality-specific specialization in semantics: A computational account of optic aphasia. Cognitive Neuropsychology, 19, 603-639.
51. Plaut, D. C., & Hinton, G. E. (1987). Learning sets of filters using back-propagation. Computer Speech and Language, 2, 35-61.
52. Plaut, D. C., & Shallice, T. (1993). Deep dyslexia: A case study of connectionist neuropsychology. Cognitive Neuropsychology, 10, 377-500.
53. Quartz, S. R. (1999). The constructivist brain. Trends in Cognitive Sciences, 3, 48-57.
54. Reisinger, J., Stanley, K. O., & Miikkulainen, R. (2004). Evolving reusable neural modules. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2004), (pp. 69-81). New York: Springer-Verlag.
55. Ringo, J. L. (1991). Neuronal interconnection as a function of brain size. Brain Behavior and Evolution, 38, 1-6.
56. Rueckl, J. G., Cave, K. R., & Kosslyn, S. M. (1989). Why are "what" and "where" processed by separate cortical visual systems? A computational investigation. Journal of Cognitive Neuroscience, 1, 171-186.
57. Sartori, G. (1988). From neuropsychological data to theory and vice versa. In G. Denes, P. Bisiacchi, C. Semenza, & E. Andrewsky (Eds.), Perspectives in Cognitive Neuropsychology. London, UK: Erlbaum.
58. Seok, B. (2006). Diversity and unity of modularity. Cognitive Science, 30, 347-380.
59. Shallice, T. (1988). From neuropsychology to mental structure. Cambridge, UK: Cambridge University Press.
60. Sporns, O., Chialvo, D. R., Kaiser, M., & Hilgetag, C. C. (2004). Organization, development and function of complex brain networks. Trends in Cognitive Sciences, 8, 418-425.
61. Stevens, C. F. (1989). How cortical interconnectedness varies with network size. Neural Computation, 1, 473-479.
62. Teuber, H. L. (1955). Physiological psychology. Annual Review of Psychology, 6, 267-296.
63. Ungerleider, L. G., & Haxby, J. V. (1994). 'What' and 'where' in the human brain. Current Opinion in Neurobiology, 4, 157-165.
64. Van Orden, G. C., Pennington, B. F., & Stone, G. O. (2001). What do double dissociations prove? Cognitive Science, 25, 111-172.
65. Wagner, G. P. (1996). Homologues, natural kinds, and the evolution of modularity. American Zoologist, 36, 36-43.
66. Watts, D. J., & Strogatz, S. H. (1998). Collective dynamics of 'small world' networks. Nature, 393, 440-442.
67. Wood, C. C. (1978). Variations on a theme of Lashley: Lesion experiments on the neural model of Anderson, Silverstein, Ritz, & Jones. Psychological Review, 85, 582-591.
68. Yao, X. (1999). Evolving artificial neural networks. Proceedings of the IEEE, 87, 1423-1447.