What Learning Systems do Intelligent Agents Need? Complementary Learning Systems Theory Updated

Trends in Cognitive Sciences

Volumn 20, Issue 7, 2016, Pages 512-534

  Kumaran, Dharshan ^a,b   Hassabis, Demis ^a,c   McClelland, James L ^d  

^a DEEPMIND   (United Kingdom)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c UNIVERSITY COLLEGE LONDON   (United Kingdom)

^d STANFORD UNIVERSITY   (United States)

Author keywords

Artificial intelligence; Hippocampus; Learning; Memory

Indexed keywords

ARTIFICIAL INTELLIGENCE; BRAIN; DATA STORAGE EQUIPMENT; INTELLIGENT AGENTS; KNOWLEDGE REPRESENTATION;

ARTIFICIAL INTELLIGENT; COMPLEMENTARY LEARNING; HIPPOCAMPUS; LEARNING;

LEARNING SYSTEMS;

ARTIFICIAL INTELLIGENCE; HIPPOCAMPUS; MACHINE LEARNING; MEMORY; NEUROSCIENCE; SYSTEMS THEORY; ANIMAL; BIOLOGICAL MODEL; HUMAN; INTELLIGENCE; LEARNING; NEOCORTEX; NERVE TRACT; PHYSIOLOGY;

ANIMALS; HIPPOCAMPUS; HUMANS; INTELLIGENCE; LEARNING; MEMORY; MODELS, NEUROLOGICAL; NEOCORTEX; NEURAL PATHWAYS; SYSTEMS THEORY;

EID: 84974531647     PISSN: 13646613     EISSN: 1879307X     Source Type: Journal    
DOI: 10.1016/j.tics.2016.05.004     Document Type: Review

References (187)

1. McClelland J.L., et al. Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. Psychol. Rev. 1995, 102:419-457.
2. O'Neill J., et al. Play it again: reactivation of waking experience and memory. Trends Neurosci. 2010, 33:220-229.
3. Wikenheiser A.M., Redish A.D. Decoding the cognitive map: ensemble hippocampal sequences and decision making. Curr. Opin. Neurobiol. 2015, 32:8-15.
4. Zeithamova D., et al. The hippocampus and inferential reasoning: building memories to navigate future decisions. Front. Hum. Neurosci. 2012, 6:1-14.
5. Kumaran D., McClelland J.L. Generalization through the recurrent interaction of episodic memories: A model of the hippocampal system. Psychol. Rev. 2012, 119:573-616.
6. Eichenbaum H. Hippocampus: cognitive processes and neural representations that underlie declarative memory. Neuron 2004, 44:109-120.
7. Tse D., et al. Schemas and memory consolidation. Science 2007, 316:76-82.
8. Tse D., et al. Schema-dependent gene activation and memory encoding in neocortex. Science 2011, 333:891-895.
9. Marr D. Simple memory: a theory for archicortex. Philos. Trans. R. Soc. L. B Biol. Sci. 1971, 262:23-81.
10. Rumelhart D.E., et al. Learning representations by back-propagating errors. Nature 1986, 323:533-536.
11. Sejnowski T.J., Rosenberg C.R. Parallel networks that learn to pronounce English text. Complex Syst. 1987, 1:145-168.
12. Guyonneau R., et al. Temporal codes and sparse representations: a key to understanding rapid processing in the visual system. J. Physiol. Paris 2004, 98:487-497.
13. Plaut D.C., et al. Understanding normal and impaired word reading: computational principles in quasi-regular domains. Psychol. Rev. 1996, 103:56-115.
14. Rogers T.T., McClelland J.L. Semantic Cognition: A Parallel Distributed Processing Approach 2004, MIT Press.
15. Rumelhart D.E. Brain style computation: learning and generalization. An Introduction to Electronic and Neural Networks 1990, 405-420. Academic Press. S.F. Zornetzer (Ed.).
16. LeCun Y., et al. Deep learning. Nature 2015, 521:436-444.
17. Yamins D.L., et al. Performance-optimized hierarchical models predict neural responses in higher visual cortex. Proc. Natl. Acad. Sci. U.S.A. 2014, 111:8619-8624.
18. Yamins D.L., DiCarlo J.J. Using goal-driven deep learning models to understand sensory cortex. Nat. Neurosci. 2016, 19:356-365.
19. Saxe A.M., et al. Learning hierarchical categories in deep neural networks. Proceedings of the 35th Annual Conference of the Cognitive Science Society 2015, 1271-1276.
20. Saxe A.M., et al. Exact solutions to the nonlinear dynamics of learning in deep linear neural networks 2014, Published online December 20, 2013. http://arxiv.org/abs/1312.6120.
21. McCloskey M., Cohen N.J. Catastrophic forgetting in connectionist networks: the problem of sequential learning. The Psychology of Learning and Motivation (Vol. 20) 1989, 109-165. Academic Press. G.H. Bower (Ed.).
22. Ratcliff R. Connectionist models of recognition memory: constraints imposed by learning and forgetting functions. Psychol. Rev. 1990, 97:285-308.
23. French R.M. Catastrophic forgetting in connectionist networks. Trends Cogn. Sci. 1999, 3:128-135.
24. Carpenter G.A., Grossberg S. A massively parallel architecture for a self-organizing neural pattern recognition architecture. Comput. Vision, Graph. Image Process. 1987, 37:54-115.
25. McNaughton B.L., Morris R.G. Hippocampal synaptic enhancement and information storage within a distributed memory system. Trends Neurosci. 1987, 10:408-415.
26. Treves A., Rolls E.T. Computational constraints suggest the need for two distinct input systems to the hippocampal CA3 network. Hippocampus 1992, 2:189-199.
27. O'Reilly R.C., McClelland J.L. Hippocampal conjunctive encoding, storage, and recall: avoiding a trade-off. Hippocampus 1994, 4:661-682.
28. Knierim J.J., et al. Hippocampal place cells: parallel input streams, subregional processing, and implications for episodic memory. Hippocampus 2006, 16:755-764.
29. Cohen N.J., Eichenbaum H.B. Memory, Amnesia and the Hippocampal System 1994, MIT Press.
30. O'Reilly R.C., Rudy J.W. Conjunctive representations in learning and memory: principles of cortical and hippocampal function. Psychol. Rev. 2001, 108:311-345.
31. Norman K.A., O'Reilly R.C. Modeling hippocampal and neocortical contributions to recognition memory: a complementary-learning-systems approach. Psychol. Rev. 2003, 110:611-646.
32. Mayes A., et al. Associative memory and the medial temporal lobes. Trends Cogn. Sci. 2007, 11:126-135.
33. Davachi L. Item, context and relational episodic encoding in humans. Curr. Opin. Neurobiol. 2006, 16:693-700.
34. Squire L.R., et al. The medial temporal lobe. Annu. Rev. Neurosci. 2004, 27:279-306.
35. Schiller D., et al. Memory and space: towards an inderstanding of the cognitive map. J. Neurosci. 2015, 35:13904-13911.
36. O'Reilly R.C., et al. Complementary learning systems. Cogn. Sci. 2014, 38:1229-1248.
37. Knierim J.J., Neunuebel J.P. Tracking the flow of hippocampal computation: pattern separation, pattern completion, and attractor dynamics. Neurobiol. Learn. Mem. 2016, 129:38-49.
38. Johnston S.T., et al. Paradox of pattern separation and adult neurogenesis: a dual role for new neurons balancing memory resolution and robustness. Neurobiol. Learn. Mem. 2016, 129:60-68.
39. Bengio Y., et al. Representation learning: a review and new perspectives. IEEE Trans. Pattern Anal. Mach. Intell. 2013, 35:1798-1828.
40. Khaligh-Razavi S.M., Kriegeskorte N. Deep supervised, but not unsupervised, models may explain IT cortical representation. PLoS Comput. Biol. 2014, 10:e1003915.
41. Kriegeskorte N., et al. Matching categorical object representations in inferior temporal cortex of man and monkey. Neuron 2008, 60:1126-1141.
42. Clarke A., Tyler L.K. Object-specific semantic coding in human perirhinal cortex. J. Neurosci. 2014, 34:4766-4775.
43. Kiani R., et al. Object category structure in response patterns of neuronal population in monkey inferior temporal cortex. J. Neurophysiol. 2007, 97:4296-4309.
44. McNaughton B.L. Cortical hierarchies, sleep, and the extraction of knowledge from memory. Artficial Intell. 2010, 174:205-2014.
45. Leibold C., Kempter R. Sparseness constrains the prolongation of memory lifetime via synaptic metaplasticity. Cereb. Cortex 2008, 18:67-77.
46. Rolls E.T., et al. The representational capacity of the distributed encoding of information provided by populations of neurons in primate temporal visual cortex. Exp. Brain Res. 1997, 114:149-162.
47. Barnes C.A., et al. Comparison of spatial and temporal characteristics of neuronal activity in sequential stages of hippocampal processing. Prog. Brain Res. 1990, 83:287-300.
48. McKenzie S., et al. Representation of memories in the cortical-hippocampal system: results from the application of population similarity analyses. Neurobiol. Learn. Mem. 2015, Published online December 31, 2015. 10.1016/j.nlm.2015.12.008.
49. Cutting J. A cognitive approach to Korsakoff's syndrome. Cortex 1978, 14:485-495.
50. McClelland J.L. Memory as a constructive process: the parallel-distributed processing apporach. The Memory Process: Neuroscientific and Humanist Perspectives 2011, 99-129. MIT Press. P. Nalbantian (Ed.).
51. Frankland P.W., Bontempi B. The organization of recent and remote memories. Nat. Rev. Neurosci. 2005, 6:119-130.
52. Winocur G., et al. Memory formation and long-term retention in humans and animals: convergence towards a transformation account of hippocampal-neocortical interactions. Neuropsychologia 2010, 48:2339-2356.
53. Squire L.R., et al. The medial temporal region and memory consolidation: a new hypothesis. Memory Consolidation: Psychobiology of Cognition 1984, 185-210. Psychology Press. H. Weingartner, E.S. Parker (Eds.).
54. Robins A. Consolidation in neural networks and in the sleeping brain. Conn. Sci. 1996, 8:259-276.
55. Tononi G., Cirelli C. Sleep and the price of plasticity: from synaptic and cellular homeostasis to memory consolidation and integration. Neuron 2014, 81:12-34.
56. Norman K.A., et al. Methods for reducing interference in the complementary learning systems model: oscillating inhibition and autonomous memory rehearsal. Neural Netw. 2005, 18:1212-1228.
57. Skaggs W.E., McNaughton B.L. Replay of neuronal firing sequences in rat hippocampus during sleep following spatial experience. Science 1996, 271:1870-1873.
58. Wilson M.A., McNaughton B.L. Reactivation of hippocampal ensemble memories during sleep. Science 1994, 265:676-679.
59. Carr M.F., et al. Hippocampal replay in the awake state: a potential substrate for memory consolidation and retrieval. Nat. Neurosci. 2011, 14:147-153.
60. Buzsaki G. Two-stage model of memory trace formation: a role for 'noisy' brain states. Neuroscience 1989, 31:551-570.
61. Kali S., Dayan P. Off-line replay maintains declarative memories in a model of hippocampal-neocortical interactions. Nat. Neurosci. 2004, 7:286-294.
62. Sirota A., et al. Communication between neocortex and hippocampus during sleep in rodents. Proc. Natl. Acad. Sci. U.S.A. 2003, 100:2065-2069.
63. Battaglia F.P., et al. Hippocampal sharp wave bursts coincide with neocortical 'up-state' transitions. Learn. Mem. 2004, 11:697-704.
64. Ólafsdóttir H., et al. Coordinated grid and place cell replay during rest. Nat. Neurosci. 2016, Published online April 18, 2016. 10.1038/nn.4291.
65. Ji D., Wilson M.A. Coordinated memory replay in the visual cortex and hippocampus during sleep. Nat. Neurosci. 2007, 10:100-107.
66. Lansink C.S., et al. Hippocampus leads ventral striatum in replay of place-reward information. PLoS Biol. 2009, 7:e1000173.
67. Ego-Stengel V., Wilson M.A. Disruption of ripple-associated hippocampal activity during rest impairs spatial learning in the rat. Hippocampus 2010, 20:1-10.
68. Girardeau G., et al. Selective suppression of hippocampal ripples impairs spatial memory. Nat. Neurosci. 2009, 12:1222-1223.
69. Nakashiba T., et al. Hippocampal CA3 output is crucial for ripple-associated reactivation and consolidation of memory. Neuron 2009, 62:781-787.
70. Johnson A., Redish A.D. Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point. J. Neurosci. 2007, 27:12176-12189.
71. Wikenheiser A.M., Redish A.D. Hippocampal theta sequences reflect current goals. Nat. Neurosci. 2015, 18:289-294.
72. Wu X., Foster D.J. Hippocampal replay captures the unique topological structure of a novel environment. J. Neurosci. 2014, 34:6459-6469.
73. Gupta A.S., et al. Hippocampal replay is not a simple function of experience. Neuron 2010, 65:695-705.
74. Pfeiffer B.E., Foster D.J. Hippocampal place-cell sequences depict future paths to remembered goals. Nature 2013, 497:74-79.
75. Ólafsdóttir H.F., et al. Hippocampal place cells construct reward related sequences through unexplored space. Elife 2015, 4:e06063.
76. Bendor D., Wilson M.A. Biasing the content of hippocampal replay during sleep. Nat. Neurosci. 2012, 15:1439-1444.
77. Schacter D.L., Addis D.R. The cognitive neuroscience of constructive memory: remembering the past and imagining the future. Philos. Trans. R. Soc. B Biol. Sci. 2007, 362:773-786.
78. Hassabis D., Maguire E.A. Deconstructing episodic memory with construction. Trends Cogn. Sci. 2007, 11:299-306.
79. Hassabis D., et al. Patients with hippocampal amnesia cannot imagine new experiences. Proc. Natl. Acad. Sci. U.S.A. 2007, 104:1726-1731.
80. Lengyel M., Dayan P. Hippocampal contributions to control: the third way. Neural Inf. Process. Syst. 2007.
81. Anderson J.R., Milson R. Human memory: an adaptive perspective. Psychol. Rev. 1989, 96:703.
82. Lisman J.E., Grace A.A. The hippocampal-VTA loop: controlling the entry of information into long-term memory. Neuron 2005, 46:703-713.
83. Lisman J., et al. A neoHebbian framework for episodic memory; role of dopamine-dependent late LTP. Trends Neurosci. 2011, 34:536-547.
84. van Strien N.M., et al. The anatomy of memory: an interactive overview of the parahippocampal-hippocampal network. Nat. Rev. Neurosci. 2009, 10:272-282.
85. Hasselmo M.E. Neuromodulation: acetylcholine and memory consolidation. Trends Cogn. Sci. 1999, 3:351-359.
86. McNamara C.G., et al. Dopaminergic neurons promote hippocampal reactivation and spatial memory persistence. Nat. Neurosci. 2014, 17:1658-1660.
87. Sara S.J. The locus coeruleus and noradrenergic modulation of cognition. Nat. Rev. Neurosci. 2009, 10:211-223.
88. McGaugh J.L. The amybdala modulates the consolidation of memories of emotionally arousing experiences. Annu. Rev. Neurosci. 2004, 27:1-28.
89. Redondo R.L., Morris R.G. Making memories last: the synaptic tagging and capture hypothesis. Nat. Rev. Neurosci. 2011, 12:17-30.
90. Kumaran D. What representations and computations underpin the contribution of the hippocampus to generalization and inference?. Front. Hum. Neurosci. 2012, 6:157.
91. Bunsey M., Eichenbaum H. Conservation of hippocampal memory function in rats and humans. Nature 1996, 379:255-257.
92. Zeithamova D., Preston A.R. Flexible memories: differential roles for medial temporal lobe and prefrontal cortex in cross-episode binding. J. Neurosci. 2010, 30:14676-14684.
93. Preston A.R., et al. Hippocampal contribution to the novel use of relational information in declarative memory. Hippocampus 2004, 14:148-152.
94. Dusek J.A., Eichenbaum H. The hippocampus and memory for orderly stimulus relations. Proc. Natl. Acad. Sci. U.S.A. 1997, 94:7109-7114.
95. Shohamy D., Wagner A.D. Integrating memories in the human brain: hippocampal-midbrain encoding of overlapping events. Neuron 2008, 60:378-389.
96. Zeithamova D., et al. Hippocampal and ventral medial prefrontal activation during retrieval-mediated learning supports novel inference. Neuron 2012, 75:168-179.
97. Milivojevic B., et al. Insight reconfigures hippocampal-prefrontal memories. Curr. Biol. 2015, 25:821-830.
98. Schlichting M.L., et al. Learning-related representational changes reveal dissociable integration and separation signatures in the hippocampus and prefrontal cortex. Nat. Commun. 2015, 6:8151.
99. Eichenbaum H., et al. The hippocampus, memory, and place cells: is it spatial memory or a memory space?. Neuron 1999, 23:209-226.
100. Howard M.W., et al. The temporal context model in spatial navigation and relational learning: toward a common explanation of medial temporal lobe function across domains. Psychol. Rev. 2005, 112:75-116.
101. Kloosterman F., et al. Two reentrant pathways in the hippocampal-entorhinal system. Hippocampus 2004, 14:1026-1039.
102. Eichenbaum H., Cohen N.J. Can we reconcile the declarative memory and spatial navigation views on hippocampal function?. Neuron 2014, 83:764-770.
103. Burgess N. Computational models of the spatial and mnemonic functions of the hippocampus. The Hippocampus 2006, 715-750. Oxford University Press. P. Andersen (Ed.).
104. Willshaw D.J., et al. Memory, modelling and Marr: a commentary on Marr (1971) 'Simple memory: a theory of archicortex'. Philos. Trans. R. Soc. B Biol. Sci. 2015, 370:20140383.
105. Schapiro A.C., et al. The necessity of the medial temporal lobe for statistical learning. J. Cogn. Neurosci. 2014, 26:1736-1747.
106. Knowlton B.J., Squire L.R. The learning of categories: parallel brain systems for item memory and category knowledge. Science 1993, 262:1747-1749.
107. Shohamy D., Turk-Browne N.B. Mechanisms for widespread hippocampal involvement in cognition. J. Exp. Psychol. Gen. 2013, 142:1159-1170.
108. Nosofsky R.M. Choice, similarity, and the context theory of classification. J. Exp. Psychol. Learn. Mem. Cogn. 1984, 10:104-114.
109. Tamminen J., et al. From specific examples to general knowledge in language learning. Cogn. Psychol. 2015, 79:1-39.
110. Walker M.P., Stickgold R. Overnight alchemy: sleep-dependent memory evolution. Nat. Rev. Neurosci. 2010, 11:218.
111. Wood E.R., et al. The global record of memory in hippocampal neuronal activity. Nature 1999, 397:613-616.
112. Eichenbaum H. Time cells in the hippocampus: a new dimension for mapping memories. Nat. Rev. Neurosci. 2014, 15:732-744.
113. McKenzie S., et al. Hippocampal representation of related and opposing memories develop within distinct, hierarchically organized neural schemas. Neuron 2014, 83:202-215.
114. Quiroga R.Q., et al. Invariant visual representation by single neurons in the human brain. Nature 2005, 435:1102-1107.
115. McClelland J.L. Incorporating rapid neocortical learning of new schema-consistent information into complementary learning systems theory. J. Exp. Psychol. Gen. 2013, 142:1190-1210.
116. McClelland J.L., Goddard N.H. Considerations arising from a complementary learning systems perspective on hippocampus and neocortex. Hippocampus 1996, 6:654-665.
117. Hinton G.E., et al. Distributed representations. Explorations in the Microstructure of Cognition. Vol. 1: Foundations 1986, 77-109. MIT Press. D.E. Rumelhart (Ed.).
118. Krizhevsky A., et al. Imagenet classification with deep convolutional neural networks. Adv. Neural Inf. Process. Syst. 2012, 25:1106-1114.
119. Mnih V., et al. Human-level control through deep reinforcement learning. Nature 2015, 518:529-533.
120. Alme C.B., et al. Place cells in the hippocampus: eleven maps for eleven rooms. Proc. Natl. Acad. Sci. U.S.A. 2014, 111:18428-18435.
121. Samsonovich A., McNaughton B.L. Path integration and cognitive mapping in a continuous attractor neural network model. J. Neurosci. 1997, 17:5900-5920.
122. Buzsaki G., Moser E.I. Memory, navigation and theta rhythm in the hippocampal-entorhinal system. Nat. Neurosci. 2013, 16:130-138.
123. Renno-Costa C., et al. A signature of attractor dynamics in the CA3 region of the hippocampus. PLoS Comput. Biol. 2014, 10:e1003641.
124. Wills T.J., et al. Attractor dynamics in the hippocampal representation of the local environment. Science 2005, 308:873-876.
125. Graves A., et al. Neural Turning machines 2014, Published online October 20, 2014. http://arxiv.org/abs/1410.5401.
126. Sukhbaatar S., et al. End-to-end memory networks. NIPS 2015, 2431-2439.
127. J. Weston, et al. Memory Networks. Published online October 15, 2014 http://arxiv.org/abs/1410.3916.
128. Scoville W.B., Milner B. Loss of recent memory after bilateral hippocampal lesions. J. Neurol. Neurosurg. Psychiatry 1957, 20:11-12.
129. Nadel L., Moscovitch M. Memory consolidation, retrograde amnesia and the hippocampal complex. Curr. Opin. Neurobiol. 1997, 7:217-227.
130. Moscovitch M., et al. Functional neuroanatomy of remote episodic, semantic and spatial memory: a unified account based on multiple trace theory. J. Anat. 2005, 207:35-66.
131. Yassa M.A., Stark C.E. Pattern separation in the hippocampus. Trends Neurosci. 2011, 34:515-525.
132. Liu X., et al. Optogenetic stimulation of a hippocampal engram activates fear memory recall. Nature 2012, 484:381-385.
133. Leutgeb J.K., et al. Pattern separation in the dentate gyrus and CA3 of the hippocampus. Science 2007, 315:961-966.
134. Leutgeb S., et al. Distinct ensemble codes in hippocampal areas CA3 and CA1. Science 2004, 305:1295-1298.
135. Bonnici H.M., et al. Decoding representations of scenes in the medial temporal lobes. Hippocampus 2011, 22:1143-1153.
136. McHugh T.J., et al. Dentate gyrus NMDA receptors mediate rapid pattern separation in the hippocampal network. Science 2007, 317:94-99.
137. Neunuebel J.P., Knierim J.J. CA3 retrieves coherent representations from degraded input: direct evidence for CA3 pattern completion and dentate gyrus pattern separation. Neuron 2014, 81:416-427.
138. Nakazawa K., et al. Requirement for hippocampal CA3 NMDA receptors in associative memory recall. Science 2002, 297:211-218.
139. Jezek K., et al. Theta-paced flickering between place-cell maps in the hippocampus. Nature 2011, 478:246-249.
140. Richards B.A., et al. Patterns across multiple memories are identified over time. Nat. Neurosci. 2014, 17:981-986.
141. Ketz N., et al. Theta coordinated error-driven learning in the hippocampus. PLoS Comput. Biol. 2013, 9:e1003067.
142. Kumaran D., Maguire E.A. Novelty signals: a window into hippocampal information processing. Trends Cogn. Sci. 2009, 13:47-54.
143. Moser E.I., Moser M.B. One-shot memory in hippocampal CA3 networks. Neuron 2003, 38:147-148.
144. Chaudhuri R., Fiete I. Computational principles of memory. Nat. Neurosci. 2016, 19:394-403.
145. Lee H., et al. Neural population evidence of functional heterogeneity along the CA3 transverse axis: pattern completion versus pattern separation. Neuron 2015, 87:1093-1105.
146. Lu L., et al. Topography of place maps along the CA3-to-CA2 axis of the hippocampus. Neuron 2015, 87:1078-1092.
147. Collin S.H., et al. Memory hierarchies map onto the hippocampal long axis in humans. Nat. Neurosci. 2015, 18:1562-1564.
148. Poppenk J., et al. Long-axis specialization of the human hippocampus. Trends Cogn. Sci. 2013, 17:230-240.
149. Strange B.A., et al. Functional organization of the hippocampal longitudinal axis. Nat. Rev. Neurosci. 2014, 15:655-669.
150. Ranganath C., Ritchey M. Two cortical systems for memory-guided behaviour. Nat. Rev. Neurosci. 2012, 13:713-726.
151. Hasselmo M.E., Schnell E. Laminar selectivity of the cholinergic suppression of synaptic transmission in rat hippocampal region CA1: computational modeling and brain slice physiology. J. Neurosci. 1994, 14:3898-3914.
152. Vazdarjanova A., Guzowski J.F. Differences in hippocampal neuronal population responses to modifications of an environmental context: evidence for distinct, yet complementary, functions of CA3 and CA1 ensembles. J. Neurosci. 2004, 24:6489-6496.
153. Olshausen B.A., Field D.J. Sparse coding of sensory inputs. Curr. Opin. Neurobiol. 2004, 14:481-487.
154. Quiroga R.Q., et al. Sparse but not 'grandmother-cell' coding in the medial temporal lobe. Trends Cogn. Sci. 2008, 12:87-91.
155. Ahmed O.J., Mehta M.R. The hippocampal rate code: anatomy, physiology and theory. Trends Neurosci. 2009, 32:329-338.
156. Tolhurst D.J., et al. The sparseness of neuronal responses in ferret primary visual cortex. J. Neurosci. 2009, 29:2355-2370.
157. Vinje W.E., Gallant J.L. Sparse coding and decorrelation in primary visual cortex during natural vision. Science 2000, 287:1273-1276.
158. Quirk G.J., et al. The positional firing properties of medial entorhinal neurons: description and comparison with hippocampal place cells. J. Neurosci. 1992, 12:1945-1963.
159. Rust N.C., DiCarlo J.J. Balanced increases in selectivity and tolerance produce constant sparseness along the ventral visual stream. J. Neurosci. 2012, 32:10170-10182.
160. Barlow H.B. Single units and sensation: a neuron doctrine for perceptual psychology?. Perception 1972, 1:371-394.
161. Grossberg S. Competitive learning: from interactive activation to adaptive resonance. Cogn. Sci. 1987, 11:23-63.
162. LaRocque K.F., et al. Global similarity and pattern separation in the human medial temporal lobe predict subsequent memory. J. Neurosci. 2013, 33:5466-5474.
163. McClelland J.L., Rumelhart D.E. An interactive activation model of context effects in letter perception. Part 1. An account of the basic findings. Psychol. Rev. 1981, 88:375-407.
164. Medin D.L., Schaffer M.M. Context theory of classification. Psychol. Rev. 1978, 85:207-238.
165. Hintzman D.L. 'Schema abstraction' in a multiple-trace memory model. Psychol. Rev. 1986, 93:411-428.
166. Suthana N.A., et al. Specific responses of human hippocampal neurons are associated with better memory. Proc. Natl. Acad. Sci. U.S.A. 2015, 112:10503-10508.
167. Wood E.R., et al. Hippocampal neurons encode information about different types of memory episodes occurring in the same location. Neuron 2000, 27:623-633.
168. Ferbinteanu J., Shapiro M.L. Prospective and retrospective memory coding in the hippocampus. Neuron 2003, 40:1227-1239.
169. Bower M.R., et al. Sequential-context-dependent hippocampal activity is not necessary to learn sequences with repeated elements. J. Neurosci. 2005, 25:1313-1323.
170. MacDonald C.J., et al. Distinct hippocampal time cell sequences represent odor memories in immobilized rats. J. Neurosci. 2013, 33:14607-14616.
171. Markus E.J., et al. Interactions between location and task affect the spatial and directional firing of hippocampal neurons. J. Neurosci. 1995, 15:7079-7094.
172. Skaggs W.E., McNaughton B.L. Spatial firing properties of hippocampal CA1 populations in an environment containing two visually identical regions. J. Neurosci. 1998, 18:8455-8466.
173. Kriegeskorte N., et al. Representational similarity analysis - connecting the branches of systems neuroscience. Front. Syst. Neurosci. 2008, 2:4.
174. Komorowski R.W., et al. Robust conjunctive item-place coding by hippocampal neurons parallels learning what happens where. J. Neurosci. 2009, 29:9918-9929.
175. Ellenbogen J.M., et al. Human relational memory requires time and sleep. Proc. Natl. Acad. Sci. U.S.A. 2007, 104:7723-7728.
176. Dumay N., Gaskell M.G. Sleep-associated changes in the mental representation of spoken words. Psychol. Sci. 2007, 18:35-39.
177. Coutanche M.N., Thompson-Schill S.L. Fast mapping rapidly integrates information into existing memory networks. J Exp Psychol Gen. 2014, 143:2296-2303.
178. Sharon T., et al. Rapid neocortical acquisition of long-term arbitrary associations independent of the hippocampus. Proc. Natl. Acad. Sci. U.S.A. 2011, 108:1146-1151.
179. Merhav M., et al. Neocortical catastrophic interference in healthy and amnesic adults: a paradoxical matter of time. Hippocampus 2014, 24:1653-1662.
180. Smith C.N., et al. Comparison of explicit and incidental learning strategies in memory-impaired patients. Proc. Natl. Acad. Sci. U.S.A. 2014, 111:475-479.
181. Warren D.E., Duff M.C. Not so fast: hippocampal amnesia slows word learning despite successful fast mapping. Hippocampus 2014, 24:920-933.
182. Greve A., et al. No evidence that 'fast-mapping' benefits novel learning in healthy older adults. Neuropsychologia 2014, 60:52-59.
183. Schaul T., et al. Prioritized experience replay. International Conference on Learning Representations 2016.
184. Gallistel C.R. The Organization of Learning 1990, MIT Press.
185. Hochreiter S., Schmidhuber J. Long short-term memory. Neural Comput. 1997, 9:1735-1780.
186. Santoro A., et al. Meta-Learning with memory augmented neural networks. International Conference in Machine Learning 2016.
187. Treves A., Rolls E.T. Computational analysis of the role of the hippocampus in memory. Hippocampus 1994, 4:374-391.