Why there are complementary learning systems in the hippocampus and neocortex: Insights from the successes and failures of connectionist models of learning and memory

Psychological Review

Volumn 102, Issue 3, 1995, Pages 419-457

  McClelland, James L ^a   McNaughton, Bruce L ^c   O'Reilly, Randall C ^b  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b CENTER FOR THE NEURAL BASIS OF COGNITION   (United States)

^c UNIVERSITY OF ARIZONA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL NEURAL NETWORK; BRAIN CORTEX; HIPPOCAMPUS; HUMAN; LEARNING; MEMORY; PATHOPHYSIOLOGY; PHYSIOLOGY; RETROGRADE AMNESIA; REVIEW;

AMNESIA, RETROGRADE; CEREBRAL CORTEX; HIPPOCAMPUS; HUMAN; LEARNING; MEMORY; NEURAL NETWORKS (COMPUTER); SUPPORT, NON-U.S. GOV'T; SUPPORT, U.S. GOV'T, NON-P.H.S.; SUPPORT, U.S. GOV'T, P.H.S.;

EID: 0029340352     PISSN: 0033295X     EISSN: None     Source Type: Journal    
DOI: 10.1037/0033-295X.102.3.419     Document Type: Article

References (97)

1. Abraham, W. C., & Otani, S. (1991). Macromolecules and the maintenance of long-term potentiation. In F. Morrell (Ed.), Kindling and synoptic plasticity (pp. 92-109). Boston: Birkhauser.
2. Ackley, D. H., Hinton, G. E., & Sejnowski, T. J. (1985). A learning algorithm for Boltzmann machines. Cognitive Science, 9, 147-169.
3. Alvarez, P., & Squire, L. R. (1994). Memory consolidation and the medial temporal lobe: A simple network model. Proceedings of the National Academy of Sciences, USA, 91, 7041-7045.
4. Barnes, C. A. (1979). Memory deficits associated with senescence: A neurophysiological and behavioral study in the rat. Journal of Comparative and Physiological Psychology, 93, 74-104.
5. Barnes, C. A. (1988). Spatial learning and memory processes: The search for their neurobiological mechanisms in the rat. Trends in Neurosciences, 11, 163-169.
6. Barnes, C. A., Jung, M. W., McNaughton, B. L., Korol, D. L., Andreasson, K., & Worley, P. F. (1994). LTP saturation and spatial learning disruption: Effects of task variables and saturation levels. Journal of Neuroscience, 14, 5793-5806.
7. Barnes, C. A., & McNaughton, B. L. (1985). An age comparison of the rates of acquisition and forgetting of spatial information in relation to long-term enhancement of hippocampal synapses. Behavioral Neuroscience, 99, 1040-1048.
8. Barnes, C. A., McNaughton, B. L., Mizumori, S. J. Y, Leonard, B. W., & Lin, L.-H. (1990). Comparison of spatial and temporal characteristics of neuronal activity in sequential stages of hippocampal processing. Progress in Brain Research, 83, 287-300.
9. Barnes, J. M., & Underwood, B. J. (1959). Fate of first-list associations in transfer theory. Journal of Experimental Psychology, 58, 97-105.
10. Barrionuevo, G., & Brown, T. H. (1983). Associative long-term synaptic potentiation in hippocampal slices. Proceedings of the National Academy of Sciences, USA, 80, 7347-7351.
11. Bartlett, F. C. (1932). Remembering. Cambridge, England: Cambridge University Press.
12. Barto, A. G., & Jordan, M. I. (1987). Gradient following without backpropagation in layered networks. In Proceedings of the IEEE International Conference on Neural Networks (Vol. 2, pp. 629-636). San Diego, CA: SOS.
13. Barto, A. G., Sutton, R. S., & Brouwer, P. S. (1981). Associative search network: A reinforcement learning associative memory. Biological Cybernetics, 40, 201-211.
14. Bliss, T. V. P., & Gardner-Medwin, A. R. (1973). Long-lasting potentiation of synaptic transmission in the dentate area of the unanaesthetized rabbit following stimulation of the perforant path. Journal of Physiology (London), 232, 357-371.
15. Bliss, T. V. P., & Lømo, T. (1973). Long-lasting potentiation of synaptic transmission in the dentate area of the anaesthetized rabbit following stimulation of the perforant path. Journal of Physiology (London), 252, 331-356.
16. Bowers, J. S., & Schacter, D. L. (1993). Implicit memory and test awareness. Journal of Experimental Psychology: Learning, Memory, and Cognition, 16, 404-416.
17. Buzsaki, G. (1989). Two-stage model of memory trace formation: A role for 'noisy' brain states. Neuroscience, 31, 551-570.
18. Chrobak, J., & Buzsaki, G. (1994). Selective activation of deep layer (V-V1) retrohippocampal neurons during hippocampal sharp waves in the behaving rat. Journal of Neuroscience, 14, 6160-6171.
19. Cleeremans, A. (1993). Mechanisms of implicit learning: Connectionist models of sequence processing. Cambridge, MA: MIT Press.
20. Cohen, J. D., & O'Reilly, R. C. (in press). A preliminary theory of the interactions between prefrontal cortex and hippocampus that contribute to planning and prospective memory. In M. Brandimonte, G. O. Einstein, & M. A. McDaniel (Eds.), Prospective memory: Theory and applications. Hove, England: Erlbaum.
21. Cohen, N. J., & Eichenbaum, H. (1993). Memory, amnesia, and the hippocampal system. Cambridge, MA: MIT Press.
22. Cohen, N. J., & Squire, L. R. (1980). Preserved learning and retention of pattern analyzing skill in amnesia: Dissociation of knowing how and knowing that. Science, 210, 207-209.
23. Collingridge, G., Kehl, S., & McLennan, H. (1983). Excitatory amino acids in synaptic transmission in the Schaffer collateral-commisural pathway of the rat hippocampus. Journal of Physiology (London). 334, 3-46.
24. Collins, A. M., & Quillian, M. R. (1969). Retrieval time from semantic memory. Journal of Verbal Learning and Verbal Behavior, 8, 240-247.
25. Cottrell, G. W., Munro, P., & Zipser, D. (1987). Learning internal representations from gray-scale images: An example of extensional programming. In Proceedings of the 9th Annual Conference of the Cognitive Science Society (pp. 462-473). Hillsdale, NJ: Erlbaum.
26. Damasio, A. R. (1989). The brain binds entities and events by multiregional activation from convergence zones. Neural Computation, 1, 123-132.
27. Darken, C., & Moody, J. (1991). Note on learning rate schedules for stochastic optimization. In R. P. Lippman, J. E. Moody, & D. S. Touretzky (Eds.), Advances in neural information processing systems 3 (pp. 832-838). Palo Alto, CA: Morgan Kaufmann.
28. Davidson, T. L., McKernan, M. G., & Jarrard, L. E. (1993). Hippocampal lesions do not impair negative patterning: A challenge to configural association theory. Behavioral Neuroscience, 107, 227-234.
29. Douglas, R. M. (1977). Long-lasting potentiation in the rat dentate gyrus following brief, high-frequency stimulation. Brain Research, 126, 361-365.
30. Eichenbaum, H., Otto, T., & Cohen, N. (1994). Two functional components of the hippocampal memory system. Behavioral and Brain Sciences, 17, 449-518.
31. Fahlman, S. E. (1981). Representing implicit knowledge. In G. E. Hinton & J. A. Anderson (Eds.), Parallel models of associative memory (pp. 145-159). Hillsdale, NJ: Erlbaum.
32. Felleman, D. J., & Van Essen, D. C. (1991). Distributed hierarchical processing in the primate cerebral cortex. Cerebral Cortex, 1, 1-47.
33. French, R. M. (1991). Using semi-distributed representations to overcome catastrophic forgetting in connectionist networks. In Proceedings of the 13th Annual Cognitive Science Conference (pp. 173-178). Hillsdale, NJ: Erlbaum.
34. French, R. M. (1992). Semi-distributed representations and catastrophic forgetting in connectionist networks. Connection Science, 4, 365-377.
35. Gaffan, D., & Murray, E. A. (1992). Monkeys (Macaco fascicularis) with rhinal cortex ablations succeed in object discrimination learning despite 24-hour intertriai intervals and fail at matching to sample despite double sample presentations. Behavioral Neuroscience, 106, 30-38.
36. Galland, C. C., & Hinton, G. E. (1991). Deterministic Boltzmann learning in networks with asymmetric connectivity. In D. S. Touretzky, J. L. Elman, T. J. Sejnowski, & G. E. Hinton (Eds.), Connectionisl models: Proceedings of the 1990 summer school (pp. 3-9). San Mateo, CA: Morgan Kaufmann.
37. Garcia, J., Ervin, F. R., & Koelling, R. A. (1966). Learning with prolonged delay of reinforcement. Psychonomic Science, 5, 121-122.
38. Gilbert, C. D. (1994). Dynamic properties of adult visual cortex. In M. S. Gazzaniga (Ed.), The cognitive neurosciences (pp. 73-90). Cambridge, MA: MIT Press.
39. Glisky, E. L., Schacter, D. L., & Tulving, E. (1986a). Computer learning by memory-impaired patients: Acquisition and retention of complex knowledge. Neuropsychologia, 24, 313-328.
40. Glisky, E. L., Schacter, D. L., & Tulving, E. (1986b). Learning and retention of computer-related vocabulary in memory-impaired patients: Method of vanishing cues. Journal of Clinical and Experimental Neuropsychology, 8, 292-312.
41. Gluck, M. A., & Myers, C. E. (1993). Hippocampal mediation of slim-ulus representation: A computational theory. Hippocampus, 3, 491-516.
42. Gold, P. E., & McGaugh, J. L. (1984). Endogenous processes in memory consolidation. In H. Weingartner & E. S. Parker (Eds.), Memory consolidation: Psychobiology of cognition (pp. 65-83). Hillsdale, NJ: Erlbaum.
43. Gothard, K. M., Skaggs, W. E., Moore, K. M., & McNaughton, B. L. (1994). Behavioral correlates of hippocampal CA1 cells in a landmark navigation task. Society for Neuroscience Abstracts, 20, 1207.
44. Gould, S., & Lewontin, R. (1979). The spandrels of San Marco and the panglossian paradigm: A critique of the adaptationist programme. Proceedings of the Royal Society, London, Series B, 205, 581-598.
45. Graf, P., & Schacter, D. L. (1987). Selective effects of interference on implicit and explicit memory for new associations. Journal of Experimental Psychology: Learning, Memory, and Cognition, 13, 45-53.
46. Graf, P., Squire, L. R., & Mandler, G. (1984). The information that amnesic patients do not forget. Journal of Experimental Psychology: Learning, Memory, and Cognition, 10, 164-178.
47. Greenough, W. T., Armstrong, K. E., Cummery, T. A., Hawry, N., Humphreys, A. G., Kleim, J., Swain, R. A., & Wang, X. (1994). Plasticity-related changes in synapse morphology. In A. I. Selverston & P. Ascher (Eds.), Cellular and molecular mechanisms underlying higher neural functions (pp. 211-220). New York: Wiley.
48. Grossberg, S. (1987). Competitive learning: From interactive activation to adaptive resonance. Cognitive Science, 11, 23-63.
49. Haist, F., Musen, G., & Squire, L. R. (1991). Intact priming of words and nonwords in amnesia. Psychobiology, 19, 275-285.
50. Harris, E. W., Ganong, A. H., & Cotman, C. W. (1984). Long-term potentiation in the hippocampus involves activation of N-methyl-D-aspartate receptors. Brain Research, 323, 132-137.
51. Hebb, D. O. (1949). The organization of behavior. New York: Wiley.
52. Hetherington, P. A., & Seidenberg, M. S. (1989). Is there 'catastrophic interference' in connectionist networks? In Proceedings of the 11th Annual Conference of the Cognitive Science Society (pp. 26-33). Hillsdale, NJ: Erlbaum.
53. Hinton, G. E. (1981). Implementing semantic networks in parallel hardware. In G. E. Hinton & J. A. Anderson (Eds.), Parallel models of associative memory (pp. 161 -187). Hillsdale, NJ: Erlbaum.
54. Hinton, G. E. (1989). Learning distributed representations of concepts. In R. G. M. Morris (Ed.), Parallel distributed processing: Implications for psychology and neurobiology (pp. 46-61). Oxford, England: Clarendon Press.
55. Hinton, G. E., & McClelland, J. L. (1988). Learning representations by recirculation. In D. Z. Anderson (Ed.), Neural information processing systems (pp. 358-366). New York: American Institute of Physics.
56. Hinton, G. E., McClelland, J. L., & Rumelhart, D. E. (1986). Distributed representations. In D. E. Rumelhart & J. L. McClelland (Eds.), Parallel distributed processing: Explorations in the microstructure of cognition (Vol. 1, pp. 77-109). Cambridge, M A: MIT Press.
57. Hopfield, J. J. (1982). Neural networks and physical systems with emergent collective computational abilities. Proceedings of the National Academy of Sciences, USA, 79, 2554-2558.
58. Howe, M. L., & Courage, M. L. (1993). On resolving the enigma of infantile amnesia. Psychological Bulletin, 113, 305-326.
59. Humphreys, M. S., Bain, J. D., & Pike, R. (1989). Different ways to cue a coherent memory system: A theory for episodic, semantic, and procedural tasks. Psychological Review, 96, 208-233.
60. James, W. (1890). Psychology (briefer course). New York: Holt.
61. Jarrard, L. E. (1989). On the use of ibotenic acid to lesion selectively different components of the hippocampal formation. Journal of Neurosdence Methods, 29, 251-259.
62. Jarrard, L. E. (1993). On the role of the hippocampus in learning and memory in the rat. Behavioral and Neural Biology. 60, 9-26.
63. Shen, B., & McNaughton, B. L. (1994). Simulation of the spontaneous reactivation of experience-specific hippocampal cell assemblies during sleep. Society for Neuroscience Abstracts, 20, 1206.
64. Shimamura, A. P., & Squire, L. R. (1987). A neuropsychological study of fact memory and source amnesia. Journal of Experimental Psychology: Learning, Memory, and Cognition, 13, 464-473.
65. Shimamura, A. P., & Squire, L. R. (1989). Impaired priming of new associations in amnesia. Journal of Experimental Psychology Learning, Memory, and Cognition, 15, 721-728.
66. Singer, W., & Artola, A. (1994). Plasticity of the mature neocortex. In A. I. Selverston & P. Ascher (Eds.), Cellular and molecular mechanisms underlying higher neural functions, (pp. 49-69). New York: Wiley.
67. Skaggs, W. E., McNaughton, B. L., Barnes, C. A., Moore, K. M., Duffield, C., Frank, L., & D'Monte, R. (1994). Sparse vs. distributed population coding in superficial and deep layers of rat neocortex. Society for Neuroscience Abstracts, 20, 1206.
68. Sloman, S. A., & Rumelhart, D. E. (1992). Reducing interference in distributed memories through episodic gating. In A. Healy, S. Kosslyn, & R. Shiffrin (Eds.), Essays in honor of W. K. Estes (Vol. 1, pp. 227-248). Hillsdale, NJ: Erlbaum.
69. Squire, L. R. (1992). Memory and the hippocampus: A synthesis from findings with rats, monkeys, and humans. Psychological Review, 99, 195-231.
70. Squire, L. R., & Cohen, N. (1979). Memory and amnesia: Resistance to disruption develops for years after learning. Behavioral and Neural Biology, 25, 115-125.
71. Squire, L. R., Cohen, N. J., & Nadel, L. (1984). The medial temporal region and memory consolidation: A new hypothesis. In H. Weingartner & E. Parker (Eds.), Memory consolidation (pp. 185-210). Hillsdale, NJ: Erlbaum.
72. Squire, L. R., Haist, F., & Shimamura, A. P. (1989). The neurology of memory: Quantitative assessment of retrograde amnesia in two groups of amnesic patients. Journal of Neuroscience, 9, 828-839.
73. Squire, L. R., Shimamura, A. P., & Amaral, D. G. (1989). Memory and the hippocampus. In J. H. Byrne & W. O. Berry (Eds.), Neural models of plasticity: Experimental and theoretical approaches (pp. 208-239). New York: Academic Press.
74. Squire, L. R., & Slater, P. C. (1975). Forgetting in very long-term memory as assessed by an improved questionnaire technique. Journal of Experimental Psychology Human Learning and Memory, 104, 50-54.
75. Squire, L. R., Slater, P. C., & Chace, P. (1975). Retrograde amnesia: Temporal gradient in very long-term memory following electroconvulsive therapy. Science, 187, 77-79.
76. Squire, L. R., Zola-Morgan, S., & Alvarez, P. (1994). Functional distinctions within the medial temporal memory system: What is the evidence? Behavioral and Brain Sciences, 17, 495-496.
77. Stewart, C., & Reid, I. C. (1993). Electroconvulsive stimulation and synaptic plasticity in the rat. Brain Research, 620, 139-141.
78. Sutherland, R. W., Arnold, K. A., & Rodriguez, A. R. (1987). Hippocampal damage produces temporally-graded retrograde amnesia in rats. Society for Neuroscience Abstracts, 13, 1066.
79. Sutherland, R. W., & Rudy, J. W. (1989). Configural association theory: The role of the hippocampal formation in learning, memory and amnesia. Psychobiology, 17, 129-144.
80. Suzuki, W. A. (1994). What can ncuroanatomy tell us about the functional components of the hippocampal memory system? Behavioral and Brain Sciences, 17, 496-498.
81. Teyler, T. J., & Discenna, P. (1986). The hippocampal memory indexing theory. Behavioral Neuroscience, 100, 147-154.
82. Touretzky, D. S., & Geva, S. (1987). A distributed connectionist representation for concept structures. In Proceedings of the 9th Annual Conference of the Cognitive Science Society (pp. 155-164). Hillsdale, NJ: Erlbaum.
83. Treves, A., & Rolls, E. T. (1994). A computational analysis of the role of the hippocampus in memory. Hippocampus, 4, 374-392.
84. Tulving, E. (1983). Elements of episodic memory. New York: Oxford University Press.
85. Warrington, E. K., & McCarthy, R. A. (1988). The fractionation of retrograde amnesia. Brain and Cognition, 7, 184-200.
86. Warrington, E. K., & Weiskrantz, L. (1978). Further analysis of the prior learning effect in amnesic patients. Neuropsychologia, 16, 169-177.
87. White, H. (1989). Learning in artificial neural networks: A statistical perspective. Neural Computation, 1, 425-464.
88. Wickelgren, W. A. (1972). Trace resistance and the decay of long-term memory. Journal of Mathematical Psychology, 9, 418-455.
89. Wickelgren, W. A. (1979). Chunking and consolidation: A theoretical synthesis of semantic networks, configuring, S-R versus cognitive learning, normal forgetting, the amnesic syndrome, and the hippocampal arousal system. Psychological Review, 86, 44-60.
90. Wigström, H., Gustaffson, B., & Huang, Y. Y (1986). Mode of action of excitatory amino acid receptor antagonists on hippocampal longlasting potentiation. Neuroscience, 17, 1105-1115.
91. Wilson, M. A., & McNaughton, B. L. (1993). Dynamics of the hippocampal ensemble code for space. Science, 261, 1055-1058.
92. Wilson, M. A., & McNaughton, B. L. (1994a). The preservation of temporal order in hippocampal memory reactivation during slowwave sleep. Society for Neuroscience Abstracts, 20, 1206.
93. Wilson, M. A., & McNaughton, B. L. (1994b). Reactivation of hippocampal ensemble memories during sleep. Science, 265, 676-679.
94. Winocur, G. (1990). Anterograde and retrograde amnesia in rats with dorsal hippocampal or dorsomedial thalamic lesions. Behavioral Brain Research, 38, 145-154.
95. Zipser, D., & Andersen, R. A. (1988). A back propagation programmed network that simulates response properties of a subset of posterior parietal neurons. Nature, 331, 679-684.
96. Zola-Morgan, S., & Squire, L. R. (1990). The primate hippocampal formation: Evidence for a time-limited role in memory storage. Science, 250, 288-290.
97. Zola-Morgan, S., Squire, L. R., & Amaral, D. G. (1986). Human amnesia and the medial temporal region: Enduring memory impairment following bilateral lesion limited to field CA1 of the hippocampus. Journal of Neuroscience, 6, 2950-2967.