Statistical mechanics beyond the Hopfield model: Solvable problems in neural network theory

Reviews in the Neurosciences

Volumn 14, Issue 1-2, 2003, Pages 181-193

  Coolen, A C C ^a   Del Prete, V ^b  

^a KING'S COLLEGE LONDON   (United Kingdom)

^b NONE

Author keywords

Recurrent neural networks; Self programming; Synchronization

Indexed keywords

ARTIFICIAL NEURAL NETWORK; COMPUTER PROGRAM; CONFERENCE PAPER; INFORMATION PROCESSING; NERVE CELL PLASTICITY; PRIORITY JOURNAL; THEORY; ACTION POTENTIAL; BRAIN; HUMAN; MENTAL FUNCTION; METHODOLOGY; NONLINEAR SYSTEM; PHYSIOLOGY; REVIEW; STATISTICS; TIME;

ACTION POTENTIALS; BRAIN; HUMANS; MENTAL PROCESSES; NEURAL NETWORKS (COMPUTER); NEURONAL PLASTICITY; NONLINEAR DYNAMICS; STATISTICS; TIME FACTORS;

EID: 0042331649     PISSN: 03341763     EISSN: None     Source Type: Journal    
DOI: 10.1515/REVNEURO.2003.14.1-2.181     Document Type: Conference Paper

References (43)

1. Amit DJ, Gutfreund H, Sompolinsky H. Spin-glass models of neural networks. Phys Rev A 1985; 32: 1007-1018.
2. Amit DJ, Gutfreund H, Sompolinsky H. Storing infinite numbers of patterns in a spin-glass model of neural networks. Phys Rev Lett 1985; 55: 1530-1533.
3. Bi G, Poo M. Synaptic modification by correlated activity: Hebb's postulate revisited. Annu Rev Neurosci 2001; 24: 139-166.
4. Braitenberg V, Schutz A. Cortex: Statistics and Geometry of Neuronal Connectivity. New York: Springer, 1998.
5. Buzsaki G. Theta oscillations in the hippocampus. Neuron 2002; 33: 325-340.
6. Caticha N. From quenched to annealed: a study of the intermediate dynamics of disorder. J Phys A 1994; 27: 5501-5507.
7. Coolen ACC. Statistical Mechanics of Recurrent Neural Networks I - Statics. In: Moss F, Gielen S, eds. Handbook of Biological Physics IV. Amsterdam: Elsevier Science, 2001; 531-596.
8. Coolen ACC. Statistical Mechanics of Recurrent Neural Networks II - Dynamics. In: Moss F, Gielen S, eds. Handbook of Biological Physics IV. Amsterdam: Elsevier Science, 2001; 597-662.
9. Coolen ACC, Penney RW, Sherrington D. Dynamics of fast spins and slow interactions in neural networks and spin systems. Phys Rev B 1993; 48: 16116-16118.
10. Csicsvari J, Hirase H, Mamiya A, Buzsaki G. Ensemble patterns of hippocampal CA3-CA1 neurons during sharp wave associated population events. Neuron 2000; 28: 585.
11. Dayan P, Abbott LF. Theoretical Neuroscience. Cambridge, MA: MIT Press, 2001.
12. Domany E, van Hemmen JL, Schulten K, eds. Models of Neural Network I. Berlin: Springer, 1991.
13. Domany E, van Hemmen JL, Schulten K, eds. Models of Neural Networks 11. Berlin: Springer, 1994.
14. Domany E, van Hemmen JL, Schulten K, eds. Models of Neural Networks III. Berlin: Springer, 1995.
15. Dong DW, Hopfield JJ. Dynamic properties of neural networks with adapting synapses. Network 1992; 3: 267-283.
16. Dotsenko V, Franz S, Mézard M. Partial annealing and overfrustration in disordered systems. J Phys A 1994; 27: 2351-2365.
17. Feldman DE, Dotsenko VS. Partially annealed neural networks. J Phys A 1994; 27: 4401-4411.
18. Gerstner W, Kistler WM. Spiking Neurons Models. Cambridge: Cambridge University Press, 2002.
19. Gray CM. The temporal correlation hypothesis of visual feature integration: still alive and well. Neuron 1999; 24: 31-41.
20. Hebb DO. The Organization of Behaviour. New York: Wiley, 1949.
21. Hodgkin AL, Huxley AF. A quantitative description of membrane current and its application to conduction and excitation in nerve. J Physiol 1952; 117: 500-544.
22. Hopfield JJ. Neural networks and physical systems with emergent collective computational abilities. Proc Natl Acad Sci USA 1982; 79: 2554-2558.
23. Hopfield JJ. Neurons with graded response properties have collective computational properties like those of two-state neurons. Proc Natl Acad Sci USA 1984; 81: 3088-3092.
24. Hubel DH, Wiesel TN, Stryker MP. Anatomical demonstration of orientation columns in macaque monkey. J Comp Neurol 1978; 177: 361-379.
25. Kühn R, Bös S, van Hemmen JL. Statistical mechanics for networks of graded-response neurons. Phys Rev A 1991; 43: 2084-2087.
26. Kuramoto Y. Chemical Oscillations, Waves and Turbulence. Berlin: Springer, 1984.
27. Mace CWH, Coolen ACC. Statistical mechanical analysis of the dynamics of leaming in a perceptron. Statistics and Computing 1998; 8: 55-88.
28. Mézard M, Parisi G, Virasoro MA. Spin-Glass Theory and Beyond. Singapore: World Scientific, 1987.
29. Mountcastle VB. Central nervous system in mechanoreceptive sensibility. In: Darian-Smith I, ed. Handbook of Physiology, Section 1: The Nervous System, Vol. III: Sensory Processes. Bethesda, MD: American Physiological Society, 1984; 789-878.
30. Ritz R, Sejnowski TJ. Synchronous oscillatory activity in sensory systems: new vistas on mechanisms. Curr Opin Neurobiol 1997; 7: 536-546.
31. Rolls ET, Treves A. Neural Networks and Brain Function. Oxford: Oxford University Press, 1997.
32. Sanes JN, Donoghue JP. Oscillations in local field potentials of the primate motor cortex during voluntary movement. Proc Natl Acad Sci USA 1993; 90: 4470-4474.
33. Shinomoto S. Memory maintenance in neural networks. J Phys A 1987; 20: L1305-L1309.
34. Singer W. Neuronal synchrony: a versatile code for the definition of relations? Neuron 1999; 24: 49.
35. Singer W, Gray CM. Visual feature integration and the temporal correlation hypothesis. Annu Rev Neurosci 1995; 19: 555-586.
36. Skantzos NS, Coolen ACC. I+∞-dimensional attractor neural networks. J Phys A 2000; 33: 5785-5807.
37. Skantzos NS, Coolen ACC. Attractor modulation and proliferation in I+∞-dimensional neural networks. J Phys A 2001; 34: 929-942.
38. Stein RB. Some models of neuronal variability. Biophys J 1967; 7: 37-68.
39. Ts'o DY, Roe AW, Gilbert CD. A hierarchy of the functional organization for color, form and disparity in primate visual area V2. Vision Res 2001; 41: 1333-1349.
40. Tucker A. MSc Project Report, King's College London, 2001.
41. Uezu T, Coolen ACC. Hierarchical self-programming in recurrent neural networks. J Phys A 2002; 35: 2761-2809.
42. Van Kampen NG. Stochastic Processes in Physics and Chemistry. Amsterdam: North-Holland, 1992.
43. Yeomans JM. Statistical Mechanics of Phase Transitions. Oxford: Clarendon Press, 1992.