The construction of semantic memory: Grammar-based representations learned from relational episodic information

Frontiers in Computational Neuroscience

Volumn , Issue AUGUST, 2011, Pages 1-22

  Battaglia, Francesco P ^a   Pennartz, Cyriel M A ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Episodic memory; Memory consolidation; Sleep replay; Stochastic grammars

Indexed keywords

ASSOCIATION MATRIX; BRAIN INJURY; EPISODIC MEMORIES; EXCHANGE OF INFORMATION; EXPECTATION MAXIMIZATION; EXPERIMENTAL EVIDENCE; GRADUAL TRANSFORMATIONS; HIPPOCAMPAL FORMATION; LONG-TERM STORAGE; MEMORY CONSOLIDATION; MEMORY MODULES; MONTE-CARLO SAMPLING; MULTIPLE LEVELS; RELATIONAL DATA; SEMANTIC MEMORY; SLEEP REPLAY; STATISTICAL REGULARITY; STOCHASTIC CONTEXT FREE GRAMMAR; STOCHASTIC GRAMMARS; TOPDOWN; EPISODIC MEMORY; EXPECTATION - MAXIMIZATIONS;

ALGORITHMS; BRAIN; CONTEXT FREE GRAMMARS; ENCODING (SYMBOLS); STOCHASTIC SYSTEMS; DIGITAL STORAGE; FORMAL LANGUAGES; MAXIMUM PRINCIPLE; MONTE CARLO METHODS;

FORMAL LANGUAGES; SLEEP RESEARCH;

ARTICLE; ASSOCIATION; CLASSIFICATION; CONTROLLED STUDY; DYNAMICS; EPISODIC MEMORY; GRAMMAR; HIPPOCAMPUS; LEARNING; LEARNING ALGORITHM; MEMORY CONSOLIDATION; MENTAL PERFORMANCE; MONTE CARLO METHOD; NEOCORTEX; NOMENCLATURE; RECALL; REPRODUCIBILITY; SAMPLING; SEMANTIC MEMORY; STOCHASTIC MODEL; ACCESS TO INFORMATION; ALGORITHM; BAYES THEOREM; CONNECTOME; DECONTEXTUALIZATION; HIPPOCAMPAL CA3 REGION; LINGUISTICS; ONLINE SYSTEM; PROBABILITY; SIMULATION;

EID: 82955167995     PISSN: 16625188     EISSN: None     Source Type: Journal    
DOI: 10.3389/fncom.2011.00036     Document Type: Article

References (92)

1. Ambros-Ingerson, J., Granger, R., and Lynch, G. (1990). Simulation of pale-ocortex performs hierarchical cluster-ing. Science 247, 1344-1348.
2. Baldi, P., and Chauvin, Y. (1994). Smooth on-line learning algorithms for hid-den markov models. Neural Comput. 6, 307-318.
3. Battaglia, F. P., Sutherland, G. R., and McNaughton, B. L. (2004). Hippocampal sharp wave bursts coincide with neocortical "up-state" transitions. Learn. Mem. 11, 697-704.
4. Bayley, P. J., Gold, J. J., Hopkins, R. O., and Squire, L. R. (2005). The neuro-anatomy of remote memory. Neuron 46, 799-810.
5. Bi, G. Q., and Poo, M. M. (1998). Synaptic modifications in cultured hippocam-pal neurons: dependence on spike timing, synaptic strength, and post-synaptic cell type. J. Neurosci. 18, 10464-10472.
6. Bod, R. (2002). A unified model of struc-tural organization in language and music. J. Artif. Intell. Res. 17, 289-308.
7. Bod, R., Hay, J., and Jannedy, S. (2003). Probabilistic Linguistics. Cambridge, MA: MIT Press.
8. Bod, R., Scha, R., and Sima'an, K. (1991). "Data-oriented parsing," in Proceedings of Computational Linguistics, Amsterdam, 26-39.
9. Borensztajn, G., Zuidema, W., and Bod, R. (2009). "The hierarchical prediction network: towards a neural theory of grammar acquisition," in 31th Annual Conference of the Cognitive Science Society, Amsterdam.
10. Chater, N., Tenenbaum, J. B., and Yuille, A. (2006). Probabilistic models of cogni-tion: conceptual foundations. Trends Cogn. Sci. (Regul. Ed.) 10, 287-291.
11. Cheng, S., and Frank, L. M. (2008). New experiences enhance coordinated neural activity in the hippocampus. Neuron 57, 303-313.
12. Cohen, N. J., and Eichenbaum, H. (1993). Memory, Amnesia, and the Hippocampal System. Cambridge, MA: MIT Press.
13. Courville, A. C., Daw, N. D., and Touretzky, D. S. (2006). Bayesian theories of con-ditioning in a changing world. Trends Cogn. Sci. (Regul. Ed.) 10, 294-300.
14. Derégnaucourt, S., Mitra, P. P., Fehér, O., Pytte, C., and Tchernichovski, O. (2005). How sleep affects the develop-mental learning of bird song. Nature 433, 710-716.
15. Dienes, Z., Altmann, G. T., and Gao, S.-J. J. (1999). Mapping across domains without feedback: a neural network model of transfer of implicit knowl-edge. Cogn. Sci. 23, 53-82.
16. Ellenbogen, J. M., Hu, P. T., Payne, J. D., Titone, D., and Walker, M. P. (2007). Human relational memory requires time and sleep. Proc. Natl. Acad. Sci. U.S.A. 104, 7723-7728.
17. Ernst, M. O., and Banks, M. S. (2002). Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415, 429-433.
18. Euston, D. R., Tatsuno, M., and McNaughton, B. L. (2007). Fast- forward playback of recent memory sequences in prefrontal cortex during sleep. Science 318, 1147-1150.
19. Felleman, D. J., and Van Essen, D. C. (1991). Distributed hierarchical pro-cessing in the primate cerebral cortex. Cereb. Cortex 1, 1-47.
20. Frankland, P. W., and Bontempi, B. (2005). The organization of recent and remote memories. Nat. Rev. Neurosci. 6, 119-130.
21. Friston, K. (2003). Learning and infer-ence in the brain. Neural Netw. 16, 1325-1352.
22. George, D., and Hawkins, J. (2009). Towards a mathematical theory of cortical micro-circuits. PLoS Comput. Biol. 5, e1000532. doi: 10.1371/journal. pcbi.1000532
23. Gómez, R. L., Bootzin, R. R., and Nadel, L. (2006). Naps promote abstraction in language-learning infants. Psychol. Sci. 17, 670-674.
24. Goodman, J. (1996). "Parsing algorithms and metrics," in Annual Meeting- Association for Computational Linguistics, Philadelphia, PA, Vol. 34, 177-183.
25. Goodman, N. D., Tenenbaum, J. B., Feldman, J., and Griffiths, T. L. (2008). A rational analysis of rule-based con-cept learning. Cogn. Sci. 32, 108-154.
26. Hinton, G. E., Sejnowski, T. J., and Ackley, D. H. (1985). Boltzmann machines: constraint satisfaction networks that learn. Cogn. Sci. 9, 147-169.
27. Hoffman, K. L., and McNaughton, B. L. (2002). Coordinated reactiva-tion of distributed memory traces in primate neocortex. Science 297, 2070-2073.
28. Hopfield, J. J. (1982). Neural networks and physical systems with emergent col-lective computational abilities. Proc. Natl. Acad. Sci. U.S.A. 79, 2554-2558.
29. Isomura, Y., Sirota, A., Ozen, S., Montgomery, S., Mizuseki, K., Henze, D. A., and Buzsáki, G. (2006). Integration and segregation of activ-ity in entorhinal-hippocampal subre-gions by neocortical slow oscillations. Neuron 52, 871-882.
30. Ji, D., and Wilson, M. A. (2007). Coordinated memory replay in the visual cortex and hippocampus dur-ing sleep. Nat. Neurosci. 10, 100-107.
31. Kahana, M. J. (1996). Associative retrieval processes in free recall. Mem. Cognit. 24, 103-109.
32. Kali, S., and Dayan, P. (2004). Off-line replay maintains declarative memories in a model of hippocampalneocortical interactions. Nat. Neurosci. 7, 286-294.
33. Kemp, C., and Tenenbaum, J. B. (2008). The discovery of structural form. Proc. Natl. Acad. Sci. U.S.A. 105, 10687-10692.
34. Kim, J. J., and Fanselow, M. S. (1992). Modality-specific retrograde amnesia of fear. Science 256, 675-677.
35. Kording, K. P., and Wolpert, D. M. (2004). Bayesian integration in sensorimotor learning. Nature 427, 244-247.
36. Kudrimoti, H. S., Barnes, C. A., and McNaughton, B. L. (1999). Reactivation of hippocampal cell assemblies: effects of behavioral state, experience, and eeg dynamics. J. Neurosci. 19, 4090-4101.
37. Lari, K., and Young, S. J. (1990). The esti-mation of stochastic context-free gram-mars using the inside-outside algorithm. Comput. Speech Lang. 4, 35-56.
38. Lee, A. K., and Wilson, M. A. (2002). Memory of sequential experience in the hippocampus during slow wave sleep. Neuron 36, 1183-1194.
39. Lee, T. S., and Mumford, D. (2003). Hierarchical Bayesian inference in the visual cortex. J. Opt. Soc. Am. A 20, 1434-1448.
40. Ljungberg, T., Apicella, P., and Schultz, W. (1992). Responses of monkey dopa-mine neurons during learning of behavioral reactions. J. Neurophysiol. 67, 145-163.
41. Manning, C., and Schütze, H. (1999). Foundations of Statistical Natural Language Processing. Cambridge, MA: MIT Press.
42. Markram, H., Lubke, J., Frotscher, M., and Sakmann, B. (1997). Regulation of synaptic efficacy by coincidence of postsynaptic aps and epsps. Science 275, 213-215.
43. Marr, D. (1971). Simple memory: a theory for archicortex. Philos. Trans. R. Soc. Lond. B Biol. Sci. 262, 23-81.
44. Maviel, T., Durkin, T. P., Menzaghi, F., and Bontempi, B. (2004). Sites of neocorti-cal reorganization critical for remote spatial memory. Science 305, 96-99.
45. McClelland, J. L., McNaughton, B. L., and O'Reilly, R. C. (1995). Why there are complementary learning systems in the hippocampus and neocor-tex: insights from the successes and failures of connectionist models of learning and memory. Psychol. Rev. 102, 419-457.
46. McNaughton, B. L., Barnes, C. A., Battaglia, F. P., Bower, M. R., Cowen, S. L., Ekstrom, A. D., Gerrard, J. L., Hoffman, K. L., Houston, F. P., Karten, Y., Lipa, P., Pennartz, C. M., and Sutherland, G. R. (2002). "Off-line reprocessing of recentmemory and its role in memory con-solidation: a progress report," in Sleep and Brain Plasticity, eds P. Maquet, B. Stickgold, and C. Smith (Oxford: Oxford University Press).
47. McNaughton, B. L., and Morris, R. G. M. (1987). Hippocampal synaptic enhancement and information storage within a distributed memory system. Trends Neurosci. 10, 408-415.
48. Mesulam, M. M., and Mufson, E. J. (1984). Neural inputs into the nucleus basalis of the substantia innominata (ch4) in the rhesus monkey. Brain 107(Pt 1), 253-274.
49. Moscovitch, M., Nadel, L., Winocur, G., Gilboa, A., and Rosenbaum, R. S. (2006). The cognitive neuroscience of remote episodic, semantic and spatial memory. Curr. Opin. Neurobiol. 16, 179-190.
50. Moscovitch, M., Rosenbaum, R. S., Gilboa, A., Addis, D. R., Westmacott, R., Grady, C., McAndrews, M. P., Levine, B., Black, S., Winocur, G., and Nadel, L. (2005). Functional neuro-anatomy of remote episodic, semantic and spatial memory: a unified account based on multiple trace theory. J. Anat. 207, 35-66.
51. Neal, R. M., and Hinton, G. E. (1998). A view of the em algorithm that justifies incremental, sparse, and other variants. Learn. Graph. Models 89, 355-368.
52. O'Neill, J., Senior, T. J., Allen, K., Huxter, J. R., and Csicsvari, J. (2008). Reactivation of experience-dependent cell assembly patterns in the hip-pocampus. Nat. Neurosci. 11, 209-215.
53. Orbán, G., Fiser, J., Aslin, R. N., and Lengyel, M. (2008). Bayesian learning of visual chunks by human observ-ers. Proc. Natl. Acad. Sci. U.S.A. 105, 2745-2750.
54. Peyrache, A., Khamassi, M., Benchenane, K., Wiener, S. I., and Battaglia, F. P. (2009). Replay of rule learning related neural patterns in the prefrontal cor-tex during sleep. Nat. Neurosci. 12, 919-926.
55. Quillian, M. R. (1968). "Semantic memory," in Semantic Information Processing, ed. M. Minsky (Cambridge, MA: MIT Press), 227-270.
56. Rabiner, L. R. (1989). A tutorial on hidden markov models and selected applications in speech recognition. Proc. IEEE 77, 257-285.
57. Rao, R. P., and Ballard, D. H. (1999). Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat. Neurosci. 2, 79-87.
58. Rasch, B., and Born, J. (2008). Maintaining memories by reactivation. Curr. Opin. Neurobiol. 17, 698-703.
59. Raven, J., Raven, J. C., and Court, J. H. (1998). Raven Manual: Sec. 4. Advanced Progressive Matrices. Oxford: Oxford Psychologists Press.
60. Rogers, T. T., and McClelland, J. L. (2004). Semantic Cognition: A Parallel Distributed Processing Approach. Cambridge, MA: MIT Press.
61. Rohlf, F. J. (1983). Numbering binary trees with labeled terminal vertices. Bull. Math. Biol. 45, 33-40.
62. Savova, V., Jakel, F., and Tenenbaum, J. B. (2009). "Grammar-based object representations in a scene parsing task," in Cognitive Science Conference, Amsterdam.
63. Savova, V., and Tenenbaum, J. B. (2008). "A grammar-based approach to visual category learning," in Cognitive Science Conference, Washington, DC.
64. Schabus, M., Hödlmoser, K., Gruber, G., Sauter, C., Anderer, P., Klösch, G., Parapatics, S., Saletu, B., Klimesch, W., and Zeitlhofer, J. (2006). Sleep spindle-related activity in the human eeg and its relation to general cognitive and learning abilities. Eur. J. Neurosci. 23, 1738-1746.
65. Scoville, W. B., and Milner, B. (1957). Loss of recent memory after bilateral hip-pocampal lesions. J. Neurol. Neurosurg. Psychiatr. 20, 11-21.
66. Shastri, L. (2002). Episodic memory and cortico-hippocampal interac-tions. Trends Cogn. Sci. (Regul. Ed.) 6, 162-168.
67. Shen, B., and McNaughton, B. L. (1996). Modeling the spontaneous reacti-vation of experience-specific hip-pocampal cell assembles during sleep. Hippocampus 6, 685-692.
68. Siapas, A. G., and Wilson, M. A. (1998). Coordinated interactions between hippocampal ripples and cortical spin-dles during slow-wave sleep. Neuron 21, 1123-1128.
69. Simoncelli, E. P., and Olshausen, B. A. (2001). Natural image statistics and neural representation. Annu. Rev. Neurosci. 24, 1193-1216.
70. Sirota, A., Csicsvari, J., Buhl, D., and Buzsáki, G. (2003). Communication between neocortex and hippocam-pus during sleep in rodents. Proc. Natl. Acad. Sci. U.S.A. 100, 2065-2069.
71. Skaggs, W. E., and McNaughton, B. L. (1996). Replay of neuronal firing sequences in rat hippocampus dur-ing sleep following spatial experience. Science 271, 1870-1873.
72. Squire, L. R. (1982). The neuropsychol-ogy of human memory. Annu. Rev. Neurosci. 5, 241-273.
73. Stolcke, A., and Omohundro, S. (1994). "Inducing probabilistic gram-mars by Bayesian model merging," in Proceedings of 2nd International Colloquium on Grammatical Inference, ICGI'94, Alicante.
74. Sutherland, R. J., and Rudy, J. W. (1989). Configural association theory: the role of the hippocampal formation in learning, memory, and amnesia. Psychobiology 17, 129-144.
75. Takashima, A., Petersson, K. M., Rutters, F., Tendolkar, I., Jensen, O., Zwarts, M. J., McNaughton, B. L., and Fernández, G. (2006). Declarative memory con-solidation in humans: a prospective functional magnetic resonance imag-ing study. Proc. Natl. Acad. Sci. U.S.A. 103, 756-761.
76. Teyler, T. J., and DiScenna, P. (1986). The hippocampal memory indexing theory. Behav. Neurosci. 100, 147-154.
77. Tomasello, M. (2005). Constructing a Language: A Usage-Based Theory of Language Acquisition. Cambridge, MA: Harvard University Press.
78. Treves, A. (2005). Frontal latching net-works: a possible neural basis for infinite recursion. Cogn. Neuropsychol. 22, 276-291.
79. Treves, A., and Rolls, E. T. (1994). Computational analysis of the role of the hippocampus in memory. Hippocampus 4, 374-391.
80. Tse, D., Langston, R. F., Kakeyama, M., Bethus, I., Spooner, P. A., Wood, E. R., Witter, M. P., and Morris, R. G. M. (2007). Schemas and memory consoli-dation. Science 316, 76-82.
81. Tulving, E., and Craik, F. I. M. (eds). (2000). Concepts of Memory. New York: Oxford University Press, 33-44.
82. Ullman, S. (2007). Object recognition and segmentation by a fragment-based hierarchy. Trends Cogn. Sci. (Regul. Ed.) 11, 58-64.
83. Valdes, J. L., McNaughton, B. L., and Fellous, J. M. (2008). Reactivation of populations of Ventral Tegmental Area neurons in the rat. Abstract 687.19, Society for Neuroscience, Washington, DC.
84. Wagner, U., Gais, S., Haider, H., Verleger, R., and Born, J. (2004). Sleep inspires insight. Nature 427, 352-355.
85. Wei, G. C. G., and Tanner, M. A. (1990). A monte carlo implementation of the em algorithm and the poor manÕs data augmentation algorithms. J. Am. Stat. Assoc. 85, 699-704.
86. Wilson, M. A., and McNaughton, B. L. (1994). Reactivation of hippocampal ensemble memories during sleep. Science 265, 676-679.
87. Winocur, G., Moscovitch, M., and Sekeres, M. (2007). Memory consolidation or transformation: context manipula-tion and hippocampal representa-tions of memory. Nat. Neurosci. 10, 555-557.
88. Yordanova, J., Kolev, V., Wagner, U., and Verleger, R. (2009). Covert reorganiza-tion of implicit task representations by slow wave sleep. PLoS ONE 4, e5675. doi: 10.1371/journal.pone.0005675
89. Yu, A. J., and Dayan, P. (2005). Uncertainty, neuromodulation, and attention. Neuron 46, 681-692.
90. Zaborszky, L., Gaykema, R. P., Swanson, D. J., and Cullinan, W. E. (1997). Cortical input to the basal forebrain. Neuroscience 79, 1051-1078.
91. Zhu, L., Chen, Y., and Yuille, A. (2007). Unsupervised learning of a probabilistic grammar for object detection and pars-ing. Adv. Neural Inf. Process Syst. 19, 1617.
92. Zola-Morgan, S. M., and Squire, L. R. (1990). The primate hippocampal formation: evidence for a time-limited role in memory storage. Science 250, 288-290.