Chaos breeds autonomy: Connectionist design between bias and baby-sitting

Cognitive Processing

Volumn 9, Issue 2, 2008, Pages 83-92

  Van Leeuwen, Cees ^a  

^a RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

Author keywords

Cognitive modeling; Complex systems; Evolving and growing neural networks; Non linear dynamics; Perception; Small world; Spontaneous activity

Indexed keywords

ALGORITHM; CHAOS THEORY; COGNITION; LEARNING; MATHEMATICAL MODEL; NERVE CELL NETWORK; PRIORITY JOURNAL; REVIEW;

ANIMALS; BIAS (EPIDEMIOLOGY); HUMANS; INTERNAL-EXTERNAL CONTROL; MODELS, PSYCHOLOGICAL; NEURAL NETWORKS (COMPUTER); NONLINEAR DYNAMICS; PERSONAL AUTONOMY; SOCIAL BEHAVIOR;

EID: 42149133132     PISSN: 16124782     EISSN: 16124790     Source Type: Journal    
DOI: 10.1007/s10339-007-0193-8     Document Type: Review

References (99)

1. Ackley DH, Hinton GE, Sejnowski TJ (1985) A learning algorithm for Boltzmann machines. Cogn Sci 9:147-169
2. Aihara K, Takabe T, Toyoda M (1990) Chaotic neural networks. Phys Lett A 144:333-340
3. Amit DJ (1986) Neural networks-achievements, prospects, difficulties. In: Paper presented at the international symposium on the physics of structure formation. Tuebingen
4. Antonini A, Stryker MP (1993) Development of individual geniculocortical arbors in cat straite cortex and effects of binocular impulse blockade. J Neurosci 13:3549-3573
5. Babloyantz A, Destexhe A (1986) Low-dimensional chaos in an instance of epilepsy. Proc Nat Acad Sci USA 83:3513-3517
6. Babloyantz A, Lourenco C (1996) Brain chaos and computation. Int J Neural Syst 7:461-471
7. Basu S, Liljenstrøm H (2001) Spontaneously active cells induce state transitions in a model of olfactory cortex. Biosystems 63:57-69
8. Bednar JA, Miikkulainen R (2003) Learning innate face preferences. Neural Comput 15:1525-1557
9. Ben-Ari Y (2001) Developing networks play a similar melody. Trends Neurosci 24:353-360
10. Ben-Ari Y, Cherubini E, Corradetti R, Gaiarsa JL (1989) Giant synaptic potentials in immature rat CA3 hippocampal neurons. J Physiol 416:303-325
11. Breakspear M, Roberts JA, Terry JR, Rodrigues S, Mahant N, Robinson PA (2006) A unifying explanation of primary generalized seizures through nonlinear brain modeling and bifurcation analysis. Cereb Cortex 16:1296-1313
12. Burke BC, Freeman WJ, Chang HJ (1998) Optimization of olfactory model in software to give 1/f power spectra reveals numerical instabilities in solutions governed by aperiodic (chaotic) attractors. Neural Netw 11:449-466
13. Caroppo D, Mannarelli M, Nardulli G, Stramaglia S (1999) Chaos in neural networks with a nonmonotonic transfer function. Phys Rev E 60:2186-2192
14. Chalmers DJ (1990) The evolution of learning: An experiment in genetic connectionism. In: Touretzky DS, Elman JL, Sejnowski TJ, Hinton GE (eds) Proceedings of the 1990 connectionist models summer school. San Matteo. Morgan Kaufmann, San Matteo, CA. http://www.citeseer.nj.nec.com/chalmers90evolution. html
15. Changeux JP, Danchin A (1976) Selective stabilisation of developing synapses as a mechanism for the specification of neuronal networks. Nature 264:705-712
16. Chiu C, Weliky M (2002) Relationship of correlated spontaneous activity to functional ocular dominance columns in developing visual cortex. Neuron 35:1123-1134
17. Dreyfus HL (1992) What computers still can't do: a critique of artificial reason. MIT Press, Boston
18. Edelman GM (1987) Neural Darwinism: the theory of neuronal group selection. Basic Books, New York
19. Edelman S, Intrator N (2003) Towards structural systematicity in distributed, statically bound visual representations. Cogn Sci 27:73-109
20. Elman JL (1991) Distributed representations, simple recurrent networks, and grammatical structure. Mach Learn 7:195-225
21. Elman JL, Bates EA, Johnson MH, Karmiloff-Smith A, Parisi D, Plunkett K (1996) Rethinking innateness: a connectionist perspective on development. MIT Press, Cambridge
22. Feller MB (1999) Spontaneous correlated activity in developing neural circuits. Neuron 22:653-656
23. Fodor JA (1975) The language of thought. Thomas Y. Crowell, New York
24. Fodor JA (1981) Representations: Philosophical essays on the foundations of cognitive science. MIT Press, Cambridge
25. Fodor JA, Pylyshyn ZW (1988) Connectionism and cognitive architecture: a critique. Cognition 28:3-71
26. Freeman WJ (2003) Evidence from human scalp electroencephalograms of global chaotic itinerancy. Chaos 13:1067-1077
27. Freeman WJ, Kozma R, Werbos PJ (2001) Biocomplexity: adaptive behavior in complex stochastic dynamical systems. Biosystems 59:109-123
28. Futschik ME, Reeve A, Kasabov N (2003 ) Evolving connectionist systems for knowledge discovery from gene expression data of cancer tissue. Artif Intell Med 28:165-189
29. Garson JW (1996) Cognition poised at the edge of chaos: a complex alternative to a symbolic mind. Philos Psychol 9:301-322
30. Garson JW (1998) Chaotic emergence and the language of thought. Philos Psychol 11:303-315
31. Gluck MA, Meeter M, Myers CE (2003) Computational models of the hippocampal region: linking incremental learning and episodic memory. Trends Cogn Sci 7:269-276
32. Gong P, van Leeuwen C (2003) Emergence of scale-free network with chaotic units. Physica A Stat Mech Appl 321:679-688
33. Gong P, van Leeuwen C (2004) Evolution to a small-world network with chaotic units. Europhys Lett 67:328-333
34. Happel BLM, Murre JMJ (1994) Design and evolution of modular neural network architectures. Neural Netw 7:985-1004
35. Harvey I (1997) Is there another new factor in evolution? Evol Comput 4:313-329
36. Hayashi Y (1994) Oscillatory neural networks and learning of continuously transformed patterns. Neural Netw 7:219-231
37. Hirsh MW (1989) Convergent activation dynamics in continuous time networks. Neural Netw 2:331-349
38. Holland JH (1975) Adaptation in natural and artificial systems. MIT Press, Cambridge
39. Ito J, Kaneko K (2003) Spontaneous structure formation in a network of dynamic elements. Phys Rev E art. No. EZ 8131
40. Ito J, Nikolaev AR, van Leeuwen C (2007) Dynamics of spontaneous transitions between global brain states. Hum Brain Mapp 28:904-913
41. Johnson MH, Morton J (1991) Biology and cognitive development: the case of face recognition. Blackwell, New York
42. Kaneko K (2002) Dominance of Milnor attractors in globally coupled dynamical systems with more than 7 +/- 2 degrees of freedom. Phys Rev E 66, art. No. 055201
43. Kaneko K, Tsuda I (2001) Complex systems: chaos and beyond. Springer, Berlin
44. Kasabov N (1998) The ECOS framework and the ECO learning method for evolving connectionist systems. J Adv Comput Intell 2:195-202
45. Katz LC, Shatz CJ (1996) Synaptic activity and the construction of cortical circuits. Science 274:1133-1138
46. Kirkpatrick S, Gelatt CD, Vecchi MP (1983) Optimization by simulated annealing. Science 220:671-680
47. Kistler WM, van Hemmen JL (2000) Modeling synaptic plasticity in conjunction with the timing of pre- and postsynaptic action potentials. Neural Comput 12:385-405
48. Kohonen T, Oja E (1976) Fast adaptive formation of orthogonalizing filters and associative memory in recurrent networks of neuron-like elements. Biol Cybern 21:85-95
49. Korn H, Faure P (2003) Is there chaos in the brain? II. Experimental evidence and related models. C R Acad Sci Series III Sci Vie 326:789-840
50. Kwok HF, Jurica P, Raffone A, van Leeuwen C (2007) Robust emergence of small-world structure in networks of spiking neurons. Cogn Neurodyn 1:39-51
51. Linsker R (1986a) From basic network principles to neural architecture, Emergence of spatial-opponent cells. Proc Nat Acad Sci USA 83:7508-7512
52. Linsker R (1986b) From basic network principles to neural architecture, emergence of orientation columns. Proc Nat Acad Sci USA 83:8779-8783
53. Maeda E, Kuroda Y, Robinson HPC, Kawana A (1998) Modification of parallel activity elicited by propagating bursts in developing networks of rat cortical neurons. Eur J Neurosci 10:488-496
54. McCormick DA (1999) Development neuroscience-spontaneous activity: signal or noise? Science 285:541-543
55. Menendez de la Prida L, Sanchez-Andres JV (2000) Heterogeneous populations of cells mediate spontaneous synchronous bursting in the developing hippocampus through a frequency-dependent mechanism. Neuroscience 97:227-241
56. Miikkulainen R (1993) Subsymbolic natural language processing: an integrated model of scripts, Lexicon and memory. MIT Press, Cambridge
57. Minsky M, Papert S (1968) Perceptrons: an introduction to computational geometry. MIT Press, Cambridge
58. Murre JMJ (1996) TraceLink: a model of amnesia and consolidation of memory. Hippocampus 6:675-684
59. Nakatani H, Khalilov I, Gong P, van Leeuwen C (2003) Evidence for chaos in giant depolarizing potentials. Phys Lett A 319:167-172
60. Nolfi S, Elman JL, Parisi D (1994) Learning and evolution in neural networks. Adapt Behav 3:5-28
61. Otsu Y, Kimura F, Tsumoto T (1995) Hebbian induction of LTP in visual cortex: perforated patch-clamp study in cultured neurons. J Neurophysiol 746:2437-2444
62. Parisi G (1986) Asymmetric neural networks and the process of learning. J Phys A Math Gen 19:L675-L680
63. Penn AA, Riquelme PA, Feller MB, Shatz CJ (1998) Competition in retinogeniculate patterning generated by spontaneous activity. Science 279:2108-2112
64. Pike FG, Meredith RM, Olding AWA, Paulsen O (1999) Postsynaptic bursting is essential for 'Hebbian' induction of associative long-term potentiation at excitatory synapses in rat hippocampus. J Physiol 518:571-576
65. Phaf RH, Den Dulk P, Tijsseling A, Lebert E (2001) Novelty-dependent learning and topological mapping. Connect Sci 13:293-321
66. Pylyshyn ZW (1984) Computation and cognition: toward a foundation for cognitive science. MIT Press, Cambridge
67. Quartz SR (1999) The constructivist brain. Trends Cogn Sci 3:48-57
68. Quartz SR, Sejnowski TJ (1997) The neural basis of cognitive development: a constructivist manifesto. Behav Brain Sci 20:537-556
69. Raffone A, van Leeuwen C (2001) Activation and coherence in memory processes: revisiting the parallel distributed processing approach to retrieval. Connect Sci 13:349-382
70. Raffone A, van Leeuwen C (2003) Dynamic synchronization and chaos in an associative neural network with multiple active memories. Chaos 13:1090-1104
71. Roy A (2000) Artificial neural networks-a science in trouble. SIGKDD Explor Newsl 1:33-38
72. Rumelhart DE, McClelland JL (eds) (1986) Parallel distributed processing: explorations in the microstructure of cognition. MIT Press, Cambridge
73. Rumelhart DE, Hinton GE, Williams RJ (1986) Learning representations by backpropagating errors. Nature 323:533-536
74. Searle J (1990) Consciousness, explanatory inversion and cognitive science. Behav Brain Sci 13:585-595
75. Scheler G, Fellous J-M (2001) Dopaminergic modulation of prefrontal delay activity-reverbaratory activity and sharpness of tuning curves. Neurocomputing 38-40:1549-1556
76. Shefi O, Golding I, Segev R, Ben-Jacob E, Ayali A (2002) Morphological characterization of in vitro neuronal networks. Phys Rev E 66, 021905.1-5
77. Siegelmann H, Sontag E (1991) Turing computability with neural nets. Appl Math Lett 4:77-80
78. Sinha S, Basak J (2002) Dynamical response of an excitatory-inhibitory neural network to external stimulation: an application to image segmentation. Phys Rev E 65, manuscript no 046112
79. Skarda CA, Freeman WJ (1987) How brains make chaos in order to make sense of the world. Behav Brain Sci 10:161-195
80. Slater A, Kirby R (1998) Innate and learned perceptual abilities in the newborn infant. Exp Brain Res 123:90-94
81. Smolensky P (1988) On the proper treatment of connectionism. Behav Brain Sci 11:1-74
82. Song S, Abbott LF (2001) Cortical development and remapping through spike timing-dependent plasticity. Neuron 32:339-350
83. Stam CJ (2004) Functional connectivity patterns of human magnetoencepahlographic recordings: a 'small-world' network? Neurosci Lett 355:25-28
84. Stephan KE, Hilgetag C-C, Burns GAPC, O'Neill MA, Young MP, Koetter R (2000) Computational analysis of functional connectivity between areas of primate cerebral cortex. Philos Trans R Soc Lond B 355:111-126
85. Steriade M, Paré D, Bouhassira D, Deschênes M, Oakson G (1989) Phasic activation of lateral geniculate and perigeniculate thalamic neurons during sleep with ponto-geniculo-occipital waves. J Neurosci 9:2215-2229
86. Suemitsu Y, Nara S (2004) A solution for two-dimensional mazes with use of chaotic dynamics in a recurrent neural network model. Neural Comput 16:1943-1957
87. Sur M, Angelucci A, Sharma J (1999) Rewiring cortex: the role of patterned activity in development and plasticity of neocortical circuits. J Neurobiol 41:33-43
88. Tanaka S (1991) Theory of ocular dominance column formation. Mathematical basis and computer simulation. Biol Cybern 64:263-272
89. Timme M, Wolf F, Geisel T (2002) Prevalence of unstable attractors in networks of pulse-coupled oscillators. Phys Rev Lett 89, art. no. 154105
90. Thompson I (1997) Cortical development: a role for spontaneous activity. Curr Biol 7:R324-R326
91. Tsuda I (1992) Dynamic link of memory-Chaotic memory map in nonequilibrium neural networks. Neural Netw 5:313-326
92. Tsuda I (2001) Towards an interpretation of dynamic neural activity in terms of chaotic dynamical systems. Behav Brain Sci 24:793-847
93. van Leeuwen C, Raffone A (2001) Coupled map Lattice models of long, short, and intermediate memory. Cogn Process 2:67-116
94. van Leeuwen C, Steyvers M, Nooter M (1997) Stability and intermittency in large-scale coupled oscillator models for perceptual segmentation. J Math Psychol 41:319-344
95. van Leeuwen C, Verver S, Brinkers M (2000) Visual illusions and outline-invariance in nonstationary activity patterns. Connect Sci 12:279-298
96. Van Pelt J, Corner MA, Wolters PS, Rutten WLC, Ramakers GJA (2004) Longterm stability and developmental changes in spontaneous network burst firing patterns in dissociated rat cerebral cortex cell cultures on multielectrode arrays. Neurosci Lett 361:86-89
97. Watanabe M, Aihara K (1997) Chaos in neural networks composed of coincidence detector neurons. Neural Netw 10:1353-1359
98. Watts DJ, Strogatz SH (1998) Collective dynamics of 'small-world' network. Nature 393:440-442
99. Yao Y, Freeman WJ (1990) Model of biological pattern recognition with spatially chaotic dynamics. Neural Netw 3:153-170