Impact of Structural Plasticity on Memory Formation and Decline

The Rewiring Brain: A Computational Approach to Structural Plasticity in the Adult Brain

Volumn , Issue , 2017, Pages 361-386

  Knoblauch, Andreas ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Catastrophic forgetting; Effectual connectivity; Learning; Memory consolidation; Potential synapse; Sharpening; Stability plasticity dilemma; Storage capacity

Indexed keywords

EID: 85032147436     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1016/B978-0-12-803784-3.00017-2     Document Type: Chapter

References (112)

1. Hebb D.O. The Organization of Behavior: A Neuropsychological Theory 1949, John Wiley and Sons, Inc., New York, NY.
2. Bliss T.V.P., Collingridge G.L. A synaptic model of memory: long-term potentiation in the hippocampus. Nature 1993, 361:31-39.
3. Paulsen O., Sejnowski T.J. Natural patterns of activity and long-term synaptic plasticity. Curr Opin Neurobiol 2000, 10:172-179.
4. Song S., Miller K.D., Abbott L.F. Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nat Neurosci 2000, 3(9):919-926.
5. Raisman G. Neuronal plasticity in the septal nuclei of the adult rat. Brain Res 1969, 14:25-48.
6. Engert F., Bonhoeffer T. Dendritic spine changes associated with hippocampal long-term synaptic plasticity. Nature 1999, 399:66-70.
7. Witte S., Stier H., Cline H.T. In vivo observations of timecourse and distribution of morphological dynamics in Xenopus retinotectal axon arbors. J Neurobiol 1996, 31:219-234.
8. Chklovskii D.B., Mel B.W., Svoboda K. Cortical rewiring and information storage. Nature 2004, 431:782-788.
9. Butz M., Wörgötter F., van Ooyen A. Activity-dependent structural plasticity. Brain Res Rev 2009, 60(2):287-305.
10. Holtmaat A., Svoboda K. Experience-dependent structural synaptic plasticity in the mammalian brain. Nat Rev Neurosci 2009, 10:647-658.
11. Yang G., Pan F., Gan W.-B. Stably maintained dendritic spines are associated with lifelong memories. Nature 2009, 462:920-924.
12. Xu T., et al. Rapid formation and selective stabilization of synapses for enduring motor memories. Nature 2009, 462:915-919.
13. Yu X., Zuo Y. Spine plasticity in the motor cortex. Curr Opin Neurobiol 2011, 21(1):169-174.
14. Fu M., Zuo Y. Experience-dependent structural plasticity in the cortex. Trends Neurosci 2011, 34(4):177-187.
15. Adelsberger-Mangan D.M., Levy W.B. The influence of limited presynaptic growth and synapse removal on adaptive synaptogenesis. Biol Cybern 1994, 71:461-468.
16. van Ooyen A., van Pelt J. Activity-dependent outgrowth of neurons and overshoot phenomena in developing neural networks. J Theor Biol 1994, 167:27-43.
17. Butz M., van Ooyen A., Wörgötter F. A model for cortical rewiring following deafferentation and focal stroke. Front Comput Neurosci 2009, 3:1-15.
18. Butz M., van Ooyen A. A simple rule for dendritic spine and axonal bouton formation can account for cortical reorganization after focal retinal lesions. PLoS Comput Biol 2013, 9(10):e1003259.
19. Tetzlaff C., Kolodziejski C., Markelic I., Wörgötter F. Time scales of memory, learning, and plasticity. Biol Cybern 2012, 106:715-726.
20. Poirazi P., Mel B.W. Impact of active dendrites and structural plasticity on the memory capacity of neural tissue. Neuron 2001, 29:779-796.
21. Knoblauch A., Palm G., Sommer F.T. Memory capacities for synaptic and structural plasticity. Neural Comput 2010, 22(2):289-341.
22. Knoblauch A., Körner E., Körner U., Sommer F.T. Structural plasticity has high memory capacity and can explain graded amnesia, catastrophic forgetting, and the spacing effect. PLoS One 2014, 9(5):e96485. 1-19.
23. Braitenberg V., Schüz A. Anatomy of the Cortex: Statistics and Geometry 1991, Springer-Verlag, Berlin, Germany.
24. Abeles M. Corticonics: Neural Circuits of the Cerebral Cortex 1991, Cambridge University Press, New York.
25. Hellwig B. A quantitative analysis of the local connectivity between pyramidal neurons in layers 2/3 of the rat visual cortex. Biol Cybern 2000, 82:111-121.
26. Lennie P. The cost of cortical computation. Curr Biol 2003, 13:493-497.
27. Laughlin S.B., Sejnowski T.J. Communication in neuronal networks. Science 2003, 301:1870-1874.
28. Attwell D., Laughlin S.B. An energy budget for signaling in the grey matter of the brain. J Cereb Blood Flow Metab 2001, 21:1133-1145.
29. Knoblauch A. The role of structural plasticity and synaptic consolidation for memory and amnesia in a model of cortico-hippocampal interplay. Connectionist Models of Behavior and Cognition II: Proceedings of the 11th Neural Computation and Psychology Workshop 2009, 79-90. World Scientific Publishing. J. Mayor, N. Ruh, K. Plunkett (Eds.).
30. Steinbuch K. Die lernmatrix. Kybernetik 1961, 1:36-45.
31. Willshaw D.J., Buneman O.P., Longuet-Higgins H.C. Non-holographic associative memory. Nature 1969, 222:960-962.
32. Marr D. Simple memory: a theory for archicortex. Philos Trans R Soc Lond Ser B 1971, 262:24-81.
33. Palm G. On associative memories. Biol Cybern 1980, 36:19-31.
34. Hopfield J.J. Neural networks and physical systems with emergent collective computational abilities. Proc Natl Acad Sci USA 1982, 79:2554-2558.
35. Buckingham J.T., Willshaw D.J. On setting unit thresholds in an incompletely connected associative net. Netw Comput Neural Syst 1993, 4:441-459.
36. Bosch H., Kurfess F. Information storage capacity of incompletely connected associative memories. Neural Netw 1998, 11(5):869-876.
37. Knoblauch A. Neural associative memory with optimal Bayesian learning. Neural Comput 2011, 23(6):1393-1451.
38. Knoblauch A. Efficient associative computation with discrete synapses. Neural Comput 2016, 28(1):118-186.
39. Chechik G., Meilijson I., Ruppin E. Synaptic pruning in development: a computational account. Neural Comput 1998, 10(7):1759-1777.
40. Huttenlocher P.R. Synaptic density in human frontal cortex-developmental changes and effects of aging. Brain Res 1979, 163(2):195-205.
41. Huttenlocher P.R., De Courten C., Garey L.J., van der Loos H. Synaptogenesis in human visual cortex - evidence for synapse elimination during normal development. Neurosci Lett 1982, 33:247-252.
42. Huttenlocher P.R., Dabholkar A.S. Regional differences in synaptogenesis in human cerebral cortex. J Comp Neurol 1997, 387:167-178.
43. Elston G.N., Oga T., Fujita I. Spinogenesis and pruning scales across functional hierarchies. J Neurosci 2009, 29(10):3271-3275.
44. Knoblauch A., Sommer F.T. Structural plasticity, effectual connectivity and memory in cortex. Front Neuroanat 2016, 10:63.
45. Stepanyants A., Hof P.R., Chklovskii D.B. Geometry and structural plasticity of synaptic connectivity. Neuron 2002, 34:275-288.
46. Braitenberg V. Cell assemblies in the cerebral cortex. Lecture Notes in Biomathematics (21) Theoretical Approaches to Complex Systems 1978, 171-188. Springer-Verlag. R. Heim, G. Palm (Eds.).
47. Palm G. Neural Assemblies. An Alternative Approach to Artificial Intelligence 1982, Springer, Berlin, Germany.
48. Squire L.R., Bayley P.J. The neuroscience of remote memory. Curr Opin Neurobiol 2007, 17:185-196.
49. Ross R.S., Eichenbaum H. Dynamics of hippocampal and cortical activation during consolidation of a nonspatial memory. J Neurosci 2006, 26(18):4852-4859.
50. Ribot T. Les maladies de la memoire 1881, (Germer Baillare.
51. French R.M. Catastrophic forgetting in connectionist networks: causes, consequences and solutions. Trends Cogn Sci 1999, 3(4):128-135.
52. Grossberg S. Competitive learning: from interactive activation to adaptive resonance. Cogn Sci 1987, 11:23-63.
53. Crowder R.G. Principles of Learning and Memory 1976, Lawrence Erlbaum, Hillsdale, NJ.
54. Greene R.L. Spacing effects in memory: evidence for a two-process account. J Exp Psychol Learn Mem Cogn 1989, 15(3):371-377.
55. Ebbinghaus, H über das Gedächtnis: Untersuchungen zur experimentellen Psychologie. (Duncker & Humblot, 1885).
56. Freedman D.J., Riesenhuber M., Poggio T., Miller E.K. Experience-dependent sharpening of visual shape selectivity in inferior temporal cortex. Cereb Cortex 2006, 16(11):1631-1644.
57. McNamara A., et al. Neural dynamics of learning sound-action associations. PLoS One 2008, 3(12):e3845.
58. Weinberger N.M., Miasnikov A.A., Chen J.C. Sensory memory consolidation observed: Increased specificity of detail over days. Neurobiol Learn Mem 2009, 91:273-286.
59. Senn W., Sacramento J. Backward reasoning the formation rule. Nat Neurosci 2001, 18(12):1705-1706.
60. Martin S.J., Grimwood P.D., Morris R.G. Synaptic plasticity and memory: an evaluation of the hypothesis. Annu Rev Neurosci 2000, 23:649-711.
61. Arshavsky Y.I. The seven sins' of the Hebbian synapse: Can the hypothesis of synaptic plasticity explain long-term memory consolidation?. Prog Neurobiol 2006, 80:99-113.
62. Bienenstock E. A model of neocortex. Netw Comput Neural Syst 1994, 6:179-224.
63. Knoblauch A., Hauser F., Gewaltig M.-O., Körner E., Palm G. Does spike-timing-dependent synaptic plasticity couple or decouple neurons firing in synchrony?. Front Comput Neurosci 2012, 6:1-27.
64. Palm G., Knoblauch A., Hauser F., Schüz A. Cell assemblies in the cerebral cortex. Biol Cybern 2014, 108(5):559-572.
65. Fay R., Kaufmann U., Knoblauch A., Markert H., Palm G. Combining visual attention, object recognition and associative information processing in a neurobotic system. Biomimetic Neural Learning for Intelligent Robots, Lecture Notes in Artificial Intelligence, LNAI 3575 2005, 118-143. Springer-Verlag. S. Wermter, G. Palm, M. Elshaw (Eds.).
66. Markert H., Knoblauch A., Palm G. Modelling of syntactical processing in the cortex. BioSystems 2007, 89(1-3):300-315.
67. Markert H., Knoblauch A., Palm G. Detecting sequences and understanding language with neural associative memories and cell assemblies. Biomimetic Neural Learning for Intelligent Robots, Lecture Notes in Artificial Intelligence, LNAI 3575 2005, 107-117. Springer-Verlag, Berlin, Germany. S. Wermter, G. Palm, M. Elshaw (Eds.).
68. Knoblauch A., Palm G. Pattern separation and synchronization in spiking associative memories and visual areas. Neural Netw 2001, 14:763-780.
69. Schwenker F., Sommer F.T., Palm G. Iterative retrieval of sparsely coded associative memory patterns. Neural Netw 1996, 9:445-455.
70. Shannon C.E., Weaver W. The Mathematical Theory of Communication 1949, University of Illinois Press, Champaign, IL.
71. Cover T.M., Thomas J.A. Elements of Information Theory 1991, John Wiley & Sons, Inc., Hoboken, NJ.
72. Nadal J.-P., Toulouse G. Information storage in sparsely coded memory nets. Netw Comput Neural Syst 1990, 1:61-74.
73. Buckingham J.T., Willshaw D.J. Performance characteristics of the associative net. Netw Comput Neural Syst 1992, 3:407-414.
74. Diederich S., Opper M. Learning of correlated patterns in spin-glass networks by local learning rules. Phys Rev Lett 1987, 58(9):949-952.
75. Palm G. On the information storage capacity of local learning rules. Neural Comput 1992, 4(5):703-711.
76. Storkey, A Artificial Neural Networks-ICANN 1997. 451-456 (Springer Verlag, 1997).
77. Dayan P., Willshaw D.J. Optimising synaptic learning rules in linear associative memory. Biol Cybern 1991, 65:253-265.
78. Waydo S., Kraskov A., Quiroga R.Q., Fried I., Koch C. Sparse representation in the human medial temporal lobe. J Neurosci 2006, 26(40):10232-10234.
79. Latham P.E., Nirenberg S. Computing and stability in cortical networks. Neural Comput 2004, 16(7):1385-1412.
80. Knoblauch, A. Zip nets: Efficient associative computation with binary synapses. In: Proceedings of the International Joint Conference on Neural Networks (IJCNN) 4271-4278. IEEE World Congress on Computational Intelligence (WCCI), 2010.
81. Frey U., Morris R.G.M. Synaptic tagging and long-term potentiation. Nature 1997, 385:533-536.
82. Fares T., Stepanyants A. Cooperative synapse formation in the neocortex. Proc Natl Acad Sci USA 2009, 106(38):16463-16468.
83. Fauth M., Wörgötter F., Tetzlaff C. Formation and maintenance of robust long-term information storage in the presence of synaptic turnover. PLoS Comput Biol 2015, 11(12):e1004684.
84. Fusi S., Drew P.J., Abbott L.F. Cascade models of synaptically stored memories. Neuron 2005, 45:599-611.
85. Mountcastle V.B. The columnar organization of the neocortex. Brain 1997, 120(4):701-722.
86. Sporns O., Tononi G., Kötter R. The Human connectome: a structural description of the human brain. PLoS Comput Biol 2005, 1(4):e42.
87. Braitenberg V., Schüz A. Anatomy of the Cortex: Statistics and Geometry 1991, Springer-Verlag, Berlin, Germany.
88. Schreiber T. Measuring information transfer. Phys Rev Lett 2000, 85:461-464.
89. Petersen C.C.H., Malenka R.C., Nicoll R.A., Hopfield J.J. All-or-none potentiation at CA3-CA1 synapses. Proc Natl Acad Sci USA 1998, 95:4732-4737.
90. O'Connor D.H., Wittenberg G.M., Wang S.S.-H. Graded bidirectional synaptic plasticity is composed of switch-like unitary events. Proc Natl Acad Sci USA 2005, 102(27):9679-9684.
91. Cepeda N.J., Pashler H., Vul E., Wixted J.T., Rohrer D. Distributed practice in verbal recall tasks: A review and quantitative synthesis. Psychol Bull 2006, 132(3):354-380.
92. Knoblauch A. Structural plasticity, cortical memory, and the spacing effect. BMC Neurosci 2009, 10(Suppl 1):O16.
93. Knoblauch A. Bimodal structural plasticity can explain the spacing effect in long-term memory tasks. Front Syst Neurosci Conf Abstr Comput Syst Neurosci 2010.
94. Buhry L., Azizi A.H., Cheng S. Reactivation, replay, and preplay: how it might all fit together. Neural Plast 2011, 2011(203462).
95. Grossberg S. How does a brain build a cognitive code. Psychol Rev 1980, 87:1-51.
96. McCloskey M., Cohen N. Catastrophic interference in connectionist networks: The sequential learning problem. Psychology of Learning and Motivation 1989, Vol. 24:109-164. Academic Press, New York.
97. Abraham C., Robins A. Memory retention-the synaptic stability versus plasticity dilemma. Trends Neurosci 2005, 28(2):73-78.
98. Robins A., McCallum S. Catastrophic forgetting and the pseudorehearsal solution in Hopfield type networks. Connect Sci 1998, 7:121-135.
99. Nadal J.-P., Toulouse G., Changeux J.P., Dehaene S. Networks of formal neurons and memory palimpsests. Europhys Lett 1986, 1(10):535-542.
100. Sandberg A., Lansner A., Petersson K.M., Ekeberg ö. A palimpsest memory based on an incremental Bayesian learning rule. Neurocomputing 2000, 32-33:987-994.
101. Aviel Y., Horn D., Abeles M. Memory capacity of balanced networks. Neural Comput 2005, 17:691-713.
102. Pagani M.R., Oishi K., Gelb B.D., Zhong Y. The phosphatase SHP2 regulates the spacing effect for long-term memory induction. Cell 2009, 139:1-13.
103. Cepeda N.J., Vul E., Rohrer D., Wixted J.T., Pashler H. Spacing effects in learning: A temporal ridgeline of optimal retention. Psychol Sci 2008, 19(11):1095-1102.
104. Meeter M., Murre J.M.J. TraceLink: a model of consolidation and amnesia. Cogn Neuropsychol 2005, 22(5):559-587.
105. Ji D., Wilson M.A. Coordinated memory replay in the visual cortex and hippocampus during sleep. Nat Neurosci 2007, 10(1):100-107.
106. Deger M., Helias M., Rotter S., Diesmann M. Spike-timing dependence of structural plasticity explains cooperative synapse formation in the neocortex. PLoS Comput Biol 2012, 8(9):e1002689.
107. Fauth M., Wörgötter F., Tetzlaff C. The formation of multi-synaptic connections by the interaction of synaptic and structural plasticity and their functional consequences. PLoS Comput Biol 2015, 11(1):e1004031.
108. Hedden T., Gabrieli J.D.E. Insights into the ageing mind: a view from cognitive neuroscience. Nat Rev Neurosci 2004, 5:87-96.
109. Song S., Sjöström P.J., Reigl M., Nelson S., Chklovskii D.B. Highly nonrandom features of synaptic connectivity in local cortical circuits. PLoS Biol 2005, 3(3):507-519.
110. Montgomery J.M., Madison D.V. Discrete synaptic states define a major mechanism of synapse plasticity. Trends Neurosci 2004, 27(12):744-750.
111. Matsuzaki M., et al. Dendritic spine geometry is critical for AMPA receptor expression in hippocampal CA1 pyramidal neurons. Nat Neurosci 2001, 4:1086-1092.
112. Knoblauch A. Neural associative memory and the Willshaw-Palm probability distribution. SIAM J Appl Math 2008, 69(1):169-196.