Recruitment and consolidation of cell assemblies for words by way of hebbian learning and competition in a multi-layer neural network

Cognitive Computation

Volumn 1, Issue 2, 2009, Pages 160-176

  Garagnani, Max ^a   Wennekers, Thomas ^b   Pulvermüller, Friedemann ^a  

^a MEDICAL RESEARCH COUNCIL   (United Kingdom)

^b UNIVERSITY OF PLYMOUTH   (United Kingdom)

Author keywords

Competitive recruitment learning; Consolidation; Language acquisition; Localist distributed representations; LTP LTD; Memory trace; Neurobiologically plausible modelling; Neurocomputation; Perception action associations; Perisylvian cortex; Synaptic plasticity

Indexed keywords

DISTRIBUTED REPRESENTATION; LANGUAGE ACQUISITION; LTP/LTD; PERCEPTION-ACTION; SYNAPTIC PLASTICITY;

COMPUTER SIMULATION; EMPLOYMENT; LINGUISTICS; MERGING; PLASTICITY;

NEURAL NETWORKS;

EID: 78049529748     PISSN: 18669956     EISSN: 18669964     Source Type: Journal    
DOI: 10.1007/s12559-009-9011-1     Document Type: Article

References (96)

1. Abeles M. Corticonics-neural circuits of the cerebral cortex. Cambridge: Cambridge University Press; 1991.
2. Abraham WC, Bear MF. Metaplasticity: the plasticity of synaptic plasticity. Trends Neurosci. 1996; 19(4): 126-30.
3. Artola A, Singer W. Long-term depression of excitatory synaptic transmission and its relationship to long-term potentiation. Trends Neurosci. 1993; 16: 480-7.
4. Artola A, Bröcher S, Singer W. Different voltage-dependent thresholds for inducing long-term depression and long-term potentiation in slices of rat visual cortex. Nature. 1990; 347: 69-72.
5. Bear MF. Mechanism for a sliding synaptic modification threshold. Neuron. 1995; 15(1): 1-4.
6. Bi GQ, Poo MM. Synaptic modification by correlated activity: Hebb's postulate revisited. Annu Rev Neurosci. 2001; 24: 139-66.
7. Bienenstock EL, Cooper LN, Munro PW. Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex. J Neurosci. 1982; 2: 32-48.
8. Braitenberg V. Cell assemblies in the cerebral cortex. In: Heim R, Palm G, editors. Theoretical approaches to complex systems, vol. 21. Berlin: Springer; 1978. p. 171-88.
9. Braitenberg V, Schüz A. Cortex: statistics and geometry of neuronal connectivity. 2nd ed. Berlin: Springer; 1998.
10. Buonomano DV, Merzenich MM. Cortical plasticity: from synapses to maps. Annu Rev Neurosci. 1998; 21: 149-86.
11. Catani M, Jones DK, Ffytche DH. Perisylvian language networks of the human brain. Ann Neurol. 2005; 57(1): 8-16.
12. Coltheart M, Davelaar E, Jonasson J, Besner D. Access to the internal lexicon. In: Dornic S, editor. Attention and performance VI. London: Academic Press; 1977. p. 535-55.
13. Corchs S, Deco G. Large-scale neural model for visual attention: integration of experimental single-cell and fMRI data. Cereb Cortex. 2002; 12(4): 339-48.
14. David O, Friston KJ. A neural mass model for MEG/EEG: coupling and neuronal dynamics. Neuroimage. 2003; 20(3): 1743-55.
15. Dayan P, Sejnowski TJ. The variance of covariance rules for associative matrix memories and reinforcement learning. Neural Comput. 1993; 5(2): 205-9.
16. Deco G, Rolls ET, Horwitz B. "What" and "where" in visual working memory: a computational neurodynamical perspective for integrating fMRI and single-neuron data. J Cogn Neurosci. 2004; 16(4): 683-701.
17. Dell GS. A spreading-activation theory of retrieval in sentence production. Psychol Rev. 1986; 93(3): 283-321.
18. Dell GS, Chang F, Griffin ZM. Connectionist models of language production: lexical access and grammatical encoding. Cogn Sci Multidiscipl J. 1999; 23(4): 517-42.
19. Diederich J. Instruction and high-level learning in connectionist networks. Connect Sci. 1989; 1: 161-80.
20. Dudek SM, Bear MF. Homosynaptic long-term depression in area Ca1 of hippocampus and effects of N-methyl-D-aspartate receptor blockade. Proc Natl Acad Sci USA. 1992; 89(10): 4363-7.
21. Eggert J, van Hemmen JL. Unifying framework for neuronal assembly dynamics. Phys Rev E. 2000; 61(2): 1855-74.
22. Elman JL, Bates EA, Johnson MH, Karmiloff-Smith A, Parisi D, Plunkett K. Rethinking innateness: a connectionist perspective on development. Cambridge, MA: MIT Press; 1996.
23. Fadiga L, Craighero L, Buccino G, Rizzolatti G. Speech listening specifically modulates the excitability of tongue muscles: a TMS study. Eur J NeuroSci. 2002; 15(2): 399-402.
24. Feldman J. Dynamic connections in neural networks. Biol Cybern. 1982; 46: 27-39.
25. Fry DB. The development of the phonological system in the normal and deaf child. In: Smith F, Miller GA, editors. The genesis of language. Cambridge, MA: MIT Press; 1966. p. 187-206.
26. Garagnani M, Wennekers T, Pulvermüller F. A neuronal model of the language cortex. Neurocomputing. 2007; 70: 1914-9.
27. Garagnani M, Wennekers T, Pulvermüller F. A neuroanatomically grounded Hebbian-learning model of attention-language interactions in the human brain. Eur J NeuroSci. 2008; 27(2): 492-513.
28. Gaskell MG, Hare M, Marslen-Wilson WD. A connectionist model of phonological representation in speech perception. Cogn Sci: Multidis J. 1995; 19(4): 407-39.
29. Gilbert CD, Wiesel TN. Clustered intrinsic connections in cat visual-cortex. J Neurosci. 1983; 3(5): 1116-33.
30. Granger CWJ. Investigating causal relations by econometric models and cross-spectral methods. Econometrica. 1969; 37(3): 424-38.
31. Grossberg S. Adaptive pattern-classification and universal recoding. 1. Parallel development and coding of neural feature detectors. Biol Cybern. 1976; 23(3): 121-34.
32. Grossberg S. Adaptive pattern-classification and universal recoding. 2. Feedback, expectation, olfaction, illusions. Biol Cybern. 1976; 23(4): 187-202.
33. Guenther FH, Ghosh SS, Tourville JA. Neural modeling and imaging of the cortical interactions underlying syllable production. Brain Lang. 2006; 96(3): 280-301.
34. Harris KD. Neural signatures of cell assembly organization. Nat Rev Neurosci. 2005; 6(5): 399-407.
35. Hebb DO. The organization of behavior. New York: John Wiley; 1949.
36. Hirsch JC, Barrionuevo G, Crepel F. Homo- and heterosynaptic changes in efficacy are expressed in prefrontal neurons: an in vitro study in the rat. Synapse. 1992; 12(1): 82-5.
37. Husain FT, Tagamets MA, Fromm SJ, Braun AR, Horwitz B. Relating neuronal dynamics for auditory object processing to neuroimaging activity: a computational modeling and an fMRI study. Neuroimage. 2004; 21(4): 1701-20.
38. Izhikevich EM, Desai NS. Relating STDP to BCM. Neural Comput. 2003; 15(7): 1511-23.
39. Joanisse MF, Seidenberg MS. Impairments in verb morphology after brain injury: a connectionist model. Proc Natl Acad Sci USA. 1999; 96(13): 7592-7.
40. Katz LC, Shatz CJ. Synaptic activity and the construction of cortical circuits. Science. 1996; 274(5290): 1133-8.
41. Kirkwood A, Rioult MC, Bear MF. Experience-dependent modification of synaptic plasticity in visual cortex. Nature. 1996; 381(6582): 526-8.
42. Kohonen T. Self-organisation and associative memory. Berlin: Springer; 1984.
43. Kohonen T, Makisara K. The self-organizing feature maps. Phys Scripta. 1989; 39(1): 168-72.
44. Krichmar JL, Seth AK, Nitz DA, Fleischer JG, Edelman GM. Spatial navigation and causal analysis in a brain-based device modeling cortical-hippocampal interactions. Neuroinformatics. 2005; 3(3): 197-221.
45. Levelt WJM, Roelofs A, Meyer AS. A theory of lexical access in speech production. Behav Brain Sci. 1999; 22: 1-75.
46. Linsker R. Self-organization in a perceptual network. Computer. 1988; 21(3): 105-17.
47. Makris N, Meyer JW, Bates JF, Yeterian EH, Kennedy DN, Caviness VS. MRI-based topographic parcellation of human cerebral white matter and nuclei II. Rationale and applications with systematics of cerebral connectivity. Neuroimage. 1999; 9(1): 18-45.
48. Malenka RC, Bear MF. LTP and LTD: an embarrassment of riches. Neuron. 2004; 44(1): 5-21.
49. Malenka RC, Nicoll RA. Neuroscience-long-term potentiation-a decade of progress? Science. 1999; 285(5435): 1870-4.
50. Marslen-Wilson WD, Tyler LK. The temporal structure of spoken language understanding. Cognition. 1980; 8: 1-71.
51. McClelland JL, Elman JL. The trace model of speech perception. Cogn Psychol. 1986; 18: 1-86.
52. McClelland JL, Rumelhart DE. Distributed memory and the representation of general and specific information. J Exp Psychol Gen. 1985; 114: 159-88.
53. Miller KD. Synaptic economics: competition and cooperation in synaptic plasticity. Neuron. 1996; 17(3): 371-4.
54. Miller KD, Mackay DJC. The role of constraints in Hebbian learning. Neural Comput. 1994; 6(1): 100-26.
55. Milner PM. Neural representation: some old problems revisited. J Cogn Neurosci. 1996; 8: 69-77.
56. Ngezahayo A, Schachner M, Artola A. Synaptic activity modulates the induction of bidirectional synaptic changes in adult mouse hippocampus. J Neurosci. 2000; 20(7): 2451-8.
57. Norris D. Shortlist-a connectionist model of continuous speech recognition. Cognition. 1994; 52(3): 189-234.
58. Page M. Connectionist modelling in psychology: a localist manifesto. Behav Brain Sci. 2000; 23(4): 443-67.
59. Palm G. Neural assemblies. Berlin: Springer; 1982.
60. Pandya DN, Yeterian EH. Architecture and connections of cortical association areas. In: Peters A, Jones EG, editors. Cerebral cortex. Vol. 4. Association and auditory cortices. London: Plenum Press; 1985. p. 3-61.
61. Parker GJ, Luzzi S, Alexander DC, Wheeler-Kingshott CA, Ciccarelli O, Lambon Ralph MA. Lateralization of ventral and dorsal auditory-language pathways in the human brain. Neuroimage. 2005; 24(3): 656-66.
62. Penke M, Westermann G. Broca's area and inflectional morphology: evidence from broca's aphasia and computer modeling. Cortex. 2006; 42(4): 563-76.
63. Petrides M, Pandya DN. Comparative cytoarchitectonic analysis of the human and the macaque ventrolateral prefrontal cortex and corticocortical connection patterns in the monkey. Eur J NeuroSci. 2002; 16(2): 291-310.
64. Plaut DC, McClelland JL, Seidenberg MS, Patterson K. Understanding normal and impaired word reading: computational principles in quasi-regular domains. Psychol Rev. 1996; 103: 56-115.
65. Press WH, Teukolski SA, Vetterling WT, Flannery BP. Numerical recipes in C: the art of scientific computing. 2nd ed. Cambridge: Cambridge University Press; 1992.
66. Pulvermüller F. Words in the brain's language. Behav Brain Sci. 1999; 22: 253-336.
67. Pulvermüller F, Preissl H. A cell assembly model of language. Netw Comput Neural Syst. 1991; 2: 455-68.
68. Pulvermüller F, Shtyrov Y. Language outside the focus of attention: the mismatch negativity as a tool for studying higher cognitive processes. Prog Neurobiol. 2006; 79(1): 49-71.
69. Pulvermüller F, Kujala T, Shtyrov Y, Simola J, Tiitinen H, Alku P, et al. Memory traces for words as revealed by the mismatch negativity. Neuroimage. 2001; 14(3): 607-16.
70. Pulvermüller F, Huss M, Kherif F, Moscoso del Prado Martin F, Hauk O, Shtyrov Y. Motor cortex maps articulatory features of speech sounds. Proc Natl Acad Sci USA. 2006; 103(20): 7865-70.
71. Rioult-Pedotti MS, Friedman D, Donoghue JP. Learning-induced LTP in neocortex. Science. 2000; 290(5491): 533-6.
72. Rogers TT, McClelland JL. Semantic cognition. Cambridge, MA: MIT Press; 1994.
73. Rogers TT, Lambon Ralph MA, Garrard P, Bozeat S, McClelland JL, Hodges JR, et al. Structure and deterioration of semantic memory: a neuropsychological and computational investigation. Psychol Rev. 2004; 111(1): 205-35.
74. Romanski LM, Tian B, Fritz J, Mishkin M, Goldman-Rakic PS, Rauschecker JP. Dual streams of auditory afferents target multiple domains in the primate prefrontal cortex. Nat Neurosci. 1999; 2(12): 1131-6.
75. Saur D, Kreher BW, Schnell S, Kummerer D, Kellmeyer P, Vry MS, et al. Ventral and dorsal pathways for language. Proc Natl Acad Sci USA. 2008; 105(46): 18035-40.
76. Seidenberg MS, McClelland JL. A distributed, developmental model of word recognition and naming. Psychol Rev. 1989; 96(4): 523-68.
77. Sejnowski TJ. Storing covariance with nonlinearly interacting neurons. J Math Biol. 1977; 4(4): 303-21.
78. Sejnowski TJ, Tesauro G. The Hebb rule for synaptic plasticity: algorithms and implementations. In: Byrne JH, Berry WO, editors. Neural models of plasticity. Sandiego: Academic Press; 1989. p. 94-103.
79. Seth AK, Edelman GM. Distinguishing causal interactions in neural populations. Neural Comput. 2007; 19(4): 910-33.
80. Shastri L. Semanti networks: an evidential formalization and its connectionist realization. Los Altos/London: Morgan Kaufmann/Pitman Publishing Company; 1988.
81. Shastri L. Biological grounding of recruitment learning and vicinal algorithms in long-term potentiation. In: Austin J, Wermter S, Willshaw D, editors. Emergent neural computational architectures based on neuroscience, lecture notes in computer science, vol. 2036. Berlin: Springer-Verlag; 2001. p. 348-67.
82. Shatz CJ. Impulse activity and the patterning of connections during CNS development. Neuron. 1990; 5(6): 745-56.
83. Shouval H, Intrator N, Cooper LN. BCM network develops orientation selectivity and ocular dominance in natural scene environment. Vision Res. 1997; 37(23): 3339-42.
84. Song S, Miller KD, Abbott LF. Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nat Neurosci. 2000; 3(9): 919-26.
85. Stanton PK, Sejnowski TJ. Associative long-term depression in the hippocampus induced by hebbian covariance. Nature. 1989; 339(6221): 215-8.
86. Tagamets MA, Horwitz B. Integrating electrophysiological and anatomical experimental data to create a large-scale model that simulates a delayed match-to-sample human brain imaging study. Cereb Cortex. 1998; 8(4): 310-20.
87. Tsumoto T. Long-term potentiation and long-term depression in the neocortex. Prog Neurobiol. 1992; 39: 209-28.
88. Turrigiano GG, Nelson SB. Homeostatic plasticity in the developing nervous system. Nat Rev Neurosci. 2004; 5(2): 97-107.
89. Turrigiano GG, Leslie KR, Desai NS, Rutherford LC, Nelson SB. Activity-dependent scaling of quantal amplitude in neocortical neurons. Nature. 1998; 391(6670): 892-6.
90. Watkins KE, Paus T. Modulation of motor excitability during speech perception: the role of Broca's area. J Cogn Neurosci. 2004; 16(6): 978-87.
91. Watkins KE, Strafella AP, Paus T. Seeing and hearing speech excites the motor system involved in speech production. Neuropsychologia. 2003; 41(8): 989-94.
92. Wennekers T, Sommer F, Aertsen A. Theories in bioscience-editorial: cell assemblies. Theory Biosci. 2003; 122(1): 1-4.
93. Westermann G, Miranda ER. A new model of sensorimotor coupling in the development of speech. Brain Lang. 2004; 89(2): 393-400.
94. Wilson HR, Cowan JD. A mathematical theory of the functional dynamics of cortical and thalamic nervous tissue. Kybernetik. 1973; 13: 35-80.
95. Wilson SM, Saygin AP, Sereno MI, Iacoboni M. Listening to speech activates motor areas involved in speech production. Nat Neurosci. 2004; 7(7): 701-2.
96. Zatorre RJ, Meyer E, Gjedde A, Evans AC. PET studies of phonetic processing of speech: review, replication, and reanalysis. Cereb Cortex. 1996; 6(1): 21-30.