Self-organization and dynamics reduction in recurrent networks: Stimulus presentation and learning

Neural Networks

Volumn 11, Issue 3, 1998, Pages 521-533

  Dauce, Emmanuel ^a   Quoy, Mathias ^b   Cessac, Bruno ^c   Doyon, Bernard ^d   Samuelides, Manuel ^a,e  

^a ONERA   (France)

^b Centre national de la recherche scientifique   (France)

^c INSTITUT NON LINÉAIRE DE NICE   (France)

^d CHU PURPAN   (France)

^e UNIVERSITÉ DE TOULOUSE   (France)

Author keywords

Asymmetric recurrent network; Attractor neural networks; Bifurcations; Chaos; Hebbian learning rule; Non linear dynamics; Self organization; Statistical neurodynamics

Indexed keywords

BIFURCATION (MATHEMATICS); CHAOS THEORY; COMPUTER ARCHITECTURE; LEARNING SYSTEMS; MATHEMATICAL MODELS;

ASYMMETRIC RECURRENT NETWORK; HEBBIAN LEARNING RULE; NONLINEAR DYNAMICS; STATISTICAL NEORODYNAMICS;

RECURRENT NEURAL NETWORKS;

ARTICLE; DYNAMICS; LEARNING; MATHEMATICAL MODEL; NERVE CELL NETWORK; OLFACTORY BULB; PRIORITY JOURNAL; STIMULUS RESPONSE;

EID: 0032053304     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0893-6080(97)00131-7     Document Type: Article

References (29)

1. Alkon D.L., Blackwell G.S., Rigler A.K., Vogl T.P. Pattern-recognition by an artificial network derived from neural biological systems. Biological Cybernetics. 62:1990;363-376.
2. Amari S.I. Characteristics of random nets of analog neuron-like elements. IEEE Transactions Systems in Man and Cybernetics. 2(5):1972;643-657.
3. Babloyantz A., Nicolis C., Salazar J.M. Evidence of chaotic dynamics of brain activity during the sleep cycle. Physics Letters. 111A:1985;152-156.
4. Ben Arous G., Guionnet A. Large deviations for Langevin spin glass dynamics. Probability Theory of Related Fields. 102:1995;455-509.
5. Changeux J.P., Dehaene S. Neuronal models of cognitive function. Cognition. 33:1989;63-109.
6. Cessac B. Increase in complexity in random neural networks. Journal de Physique I. 5:1995;409-432.
7. Cessac B., Doyon B., Quoy M., Samuclides M. Mean-field equations, bifurcation map and route to chaos in discrete time neural networks. Physica D. 74:1994;24-44.
8. Derrida B. (1988). Dynamics of automata, spin glasses and neural networks models. In Non Linear Evolution and Chaotic Phenomena. Plenum: New York.
9. Doyon B., Cessac B., Quoy M., Samuclides M. Chaos in neural networks with random connectivity. International Journal of Bifurcation and Chaos. 3(2):1993;279-291.
10. Eckhorn R., Bauer R., Jordan W., Brosch M., Kruse W., Munk M., Reitboeck H.J. Coherent oscillations: a mechanism of feature linking in the visual cortex? Multiple electrode and correlation analysis in the cat. Biological Cybernetics. 60:1988;121-130.
11. Freeman W.J., Yao Y., Burke B. Central pattern generating and recognizing in olfactory bulb: a correlation learning rule. Neural Networks. 1:1988;277-288.
12. Gallez D., Babloyantz A. Predictability of human EEG: a dynamical approach. Biological Cybernetics. 64:1991;381-392.
13. Geman S. Almost sure stable oscillations in a large system of randomly coupled equations. SIAM Journal of Applied Mathematics. 42:1982;695-703.
14. Gray C.M., Koenig P., Engel A.K., Singer W. Oscillatory responses in cat visual cortex exhibit intercolumnar synchronisation which reflects global stimulus properties. Nature. 338:1989;334-337.
15. Ginzburg I., Sompolinsky H. Theory of correlations in stochastic neural networks. Physics Review E. 50:1994;3171-3191.
16. Hebb D. (1949) The Organization of Behavior. New York: Wiley.
17. Hirsch M.W. Convergent activation dynamics in continuous time networks. Neural Networks. 2:1989;331-349.
18. Hopfield J.J. Neural networks and physical systems with emergent collective computational abilities. Proceedings of the National Academy of Science USA. 79:1982;2554-2558.
19. Linster C., Masson C., Kerszberg M., Personnaz L., Dreyfus G. Computational diversity in a formal model of the insect olfactory macroglomerulus. Neural Computation. 5:1993;228-241.
20. Molgedey L., Schuart J., Schuster H.G. Suppressing chaos in neural networks by noise. Physics Review Letters. 69(26):1992;3717-3719.
21. Palmadesso P.J., Dayhoff J.E. Attractor locking in a chaotic network: Stimulus patterns evoke limit cycles. WCNN Washington. 1:1995;254-257.
22. Quoy M., Cessac B., Doyon B., Samuclides M. Dynamical behavior of neural networks with discrete time dynamics. Neural Network World. 3(6):1993;845-848.
23. Quoy M. (1994). Apprentissage dans les réseaux neuromimétiques à dynamique chaotique. PhD Thesis, ENSAE Toulouse.
24. Quoy M., Doyon B., Samuelides M., 1995. Dimension reduction by learning in discrete time chaotic neural networks. WCNN Washington 1.
25. Renals S., 1990. Chaos in neural networks, Eurasip Workshop, 90-99.
26. Skarda C.A., Freeman W.J. How brains make chaos in order to make sense of the world. Behavioral and Brain Sciences. 10:1987;161-195.
27. Sompolinsky H., Crisanti A., Sommers H.J. Chaos in random neural networks. Physics Review Letters. 61:1988;259-262.
28. Sznitzman A.S. Non linear reflecting diffusion process and the propagation of chaos and fluctuations associated. Journal of Functional Analysis. 56:1984;311-336.
29. Yao Y., Freeman W.J. Model of biological pattern recognition with spatially chaotic dynamics. Neural Networks. 3:1990;153-170.