Hebbian learning, its correlation catastrophe, and unlearning

Network: Computation in Neural Systems

Volumn 8, Issue 3, 1997, Pages

  Van Hemmen, J L ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 4243843160     PISSN: 0954898X     EISSN: None     Source Type: Journal    
DOI: 10.1088/0954-898X_8_3_001     Document Type: Review

References (35)

1. Hobson J A 1989 Sleep (New York: Scientific American Library)
2. Hobson J A 1990 Sleep and dreaming J. Neurosci. 10 371-82
3. Winson J 1990 The meaning of dreams Sci. Am. 263 (5) 42-8
4. Crick F and Mitchison G 1983 The function of dream sleep Nature 304 111-4
5. Crick F and Mitchison G 1986 J. Mind Behav. 7 229-50
6. Gerstner W, Ritz R and van Hemmen J L 1993 Why spikes? Hebbian learning and retrieval of time-resolved excitation patterns Biol. Cybern. 69 503-15
7. Hebb D O 1949 The Organization of Behavior (New York: Wiley) p 62
8. Hopfield J J 1982 Neural networks and physical systems with emergent collective computational abilities Proc. Natl Acad. Sci. USA 79 2554-8
9. Herz A V M, Sulzer B, Kühn R and van Hemmen J L 1988 The Hebb rule: Storing static and dynamic objects in an associative neural network Europhys. Lett. 7 663-9
10. Herz A V M, Sulzer B, Kühn R and van Hemmen J L 1989 Hebbian learning reconsidered: Representation of static and dynamic objects in associative neural nets Biol. Cybern. 60 457-67
11. Herz A V M, Li Z and van Hemmen J L 1991 Statistical mechanics of temporal association in neural networks with transmission delays Phys. Rev. Lett. 66 1370-3
12. Van Hemmen J L, Gerstner W, Herz A V M, Kühn R and Vaas M 1990 Encoding and decoding of patterns which are correlated in space and time, in: Konnektionismus in Artificial Intelligence und Kognitionsforschung ed G Dorffner (Berlin: Springer) pp 153-62
13. Hopfield, J J, Feinstein D I and Palmer R G 1983 'Unlearning' has a stabilizing effect in collective memories Nature 304 158-9
14. Smith C and Kelly G 1988 Paradoxical sleep deprivation applied two days after end of training retards learning Psychol. Behav. 43 213-6
15. Karni A, Tanne D, Rubenstein B S, Askenasy J J M and Sagi D 1994 Dependence on REM sleep of overnight improvement of a perceptual skill Science 265 679-82
16. Freud S 1900 Die Traumdeutung (Leipzig: Deuticke-Verlag);
17. translation 1976 The Interpretation of Dreams (London: Penguin)
18. Pavlides C and Winson J 1989 Influences of hippocampal place cell firing in the awake state on the activity of these cells during subsequent sleep episodes J. Neurosci. 9 2907-18
19. Hennevin E, Hars B and Bloch V 1989 Improvement of learning by mesencephalic reticular stimulation during postlearning paradoxical sleep Behav. Neural Biol. 51 291-306
20. Hobson J A and McCarley R W 1977 The brain as a dream state generator: an activation-synthesis hypothesis of the dream process Am. J. Psychiatry 134 1335-48
21. Van Hemmen J L and Kühn R 1995 Collective phenomena in neural networks, in: Models of Neural Networks 1 ed E Domany, J L van Hemmen and K Schulten (Berlin: Springer) 2nd edn, pp 1-113
22. Gardner E 1988 The space of interactions in neural network models J.Phys. A: Math. Gen. 21 257-70
23. Lamperti J 1966 Probability (New York: Benjamin)
24. Van Hemmen J L, Ioffe L B, Kühn R and Vaas M 1990 Increasing the efficiency of a neural network through unlearning Physica A 163 386-92
25. Kleinfeld D and Pendergraft D B 1987 'Unlearning' increases the storage capacity of content addressable memories Biophys. J. 51 47-53
26. Van Hemmen J L and Klemmer N 1992 Unlearning and its relevance to REM sleep: Decorrelating correlated data Neural Network Dynamics ed J G Taylor, E R Caianiello, R M J Cotterill and J W Clark (Berlin: Springer) pp 40-53
27. Kanter I 1989 Convergence time in infinite-range neural networks with parallel dynamics at zero temperature Phys. Rev. A 40 2611-4
28. Wimbauer S, Klemmer N and van Hemmen J L 1994 Universality of unlearning Neural Networks 7 261-70
29. Klemmer N 1991 Diploma thesis Technical University of Munich
30. Hopfield J J 1984 Collective processing and neural states, in: Modeling in Analysis and Biomedicine ed C Nicolini (Singapore: World Scientific) pp 369-89
31. Van Hemmen J L, Keller G and Kühn R 1988 Forgetful memories Europhys. Lett. 5 663-8
32. Plakhov A Yu and Semenov S A 1994 Neural networks: Iterative unlearning algorithm converging to the projector rule matrix J. Physique 1 4 253-60
33. Markram H, Lübke J, Frotscher M and Sakmann B (1997) Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs Science 275 213-5
34. Brown T H and Chattarji S 1995 Hebbian synaptic plasticity: Evolution of the contemporary concept Models of Neural Networks I 2nd edn, ed E Domany, J L van Hemmen and K Schulten (Berlin: Springer) pp 287-314
35. Gerstner W, Kempter R, van Hemmen J L and Wagner H 1996 A neuronal learning rule for sub-millisecond temporal coding Nature 383 76-8