Structural plasticity, effectual connectivity, and memory in cortex

Frontiers in Neuroanatomy

Volumn 10, Issue JUNE, 2016, Pages

  Knoblauch, Andreas ^a   Sommer, Friedrich T ^b  

^a ALBSTADT SIGMARINGEN UNIVERSITY   (Germany)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Effective connectivity; Learning; Memory consolidation; Potential synapse; Spacing effect; Storage capacity; Synaptic plasticity; Transfer entropy

Indexed keywords

ADULT; BRAIN CORTEX; COMPUTER SIMULATION; CONNECTOME; ENTROPY; FUNCTIONAL NEUROIMAGING; INFORMATION STORAGE; LEARNING; MEMORY CONSOLIDATION; NERVE CELL PLASTICITY; STRUCTURE ACTIVITY RELATION; THEORETICAL MODEL;

EID: 84978757599     PISSN: None     EISSN: 16625129     Source Type: Journal    
DOI: 10.3389/fnana.2016.00063     Document Type: Article

References (76)

1. Abeles, M. (1991). Corticonics: Neural Circuits of the Cerebral Cortex. Cambridge: Cambridge University Press.
2. Arshavsky, Y. (2006). "The seven sins" of the hebbian synapse: can the hypothesis of synaptic plasticity explain long-term memory consolidation? Progress Neurobiol. 80, 99-113. doi: 10.1016/j.pneurobio.2006.09.004
3. Attwell, D., and Laughlin, S. (2001). An energy budget for signaling in the grey matter of the brain. J. Cereb. Blood Flow Metabol. 21, 1133-1145. doi: 10.1097/00004647-200110000-00001
4. Aviel, Y., Horn, D., and Abeles, M. (2005). Memory capacity of balanced networks. Neural Comput. 17, 691-713. doi: 10.1162/0899766053019962
5. Bliss, T., and Collingridge, G. (1993). A synaptic model of memory: long-term potentiation in the hippocampus. Nature 361, 31-39.
6. Bosch, H., and Kurfess, F. (1998). Information storage capacity of incompletely connected associative memories. Neural Netw.11, 869-876.
7. Braitenberg, V., and Schüz, A. (1991). Anatomy of the Cortex. Statistics and Geometry. Berlin: Springer-Verlag.
8. Buckingham, J., and Willshaw, D. (1992). Performance characteristics of the associative net. Network 3, 407-414.
9. Buckingham, J., and Willshaw, D. (1993). On setting unit thresholds in an incompletely connected associative net. Network 4, 441-459.
10. Butz, M., Wörgötter, F., and van Ooyen, A. (2009). Activity-dependent structural plasticity. Brain Res. Rev. 60, 287-305. doi: 10.1016/j.brainresrev.2008.12.023
11. Caporale, N., and Dan, Y. (2008). Spike timing-dependent plasticity: a hebbian learning rule. Ann. Rev. Neurosci. 31, 25-46. doi: 10.1146/annurev.neuro.31.060407.125639
12. Cepeda, N., Vul, E., Rohrer, D., Wixted, J., and Pashler, H. (2008). Spacing effects in learning: a temporal ridgeline of optimal retention. Psychol. Sci. 19, 1095-1102. doi: 10.1111/j.1467-9280.2008.02209.x
13. Chklovskii, D., Mel, B., and Svoboda, K. (2004). Cortical rewiring and information storage. Nature 431, 782-788. doi: 10.1038/nature03012
14. Clopath, C., Büsing, L., Vasilaki, E., and Gerstner, W. (2010). Connectivity reflects coding: a model of voltage-based STDP with homeostasis. Nat. Neurosci. 13, 344-352. doi: 10.1038/nn.2479
15. Cover, T., and Thomas, J. (1991). Elements of Information Theory. New York, NY: Wiley.
16. Crowder, R. (1976). Principles of Learning and Memory. Oxford: Lawrence Erlbaum.
17. Deger, M., Helias, M., Rotter, S., and Diesmann, M. (2012). Spike-timing dependence of structural plasticity explains cooperative synapse formation in the neocortex. PLoS Comput. Biol. 8:e1002689. doi: 10.1371/journal.pcbi.1002689
18. DePaola, V., Holtmaat, A., Knott, G., Song, S., Wilbrecht, L., Caroni, P., and Svoboda, K. (2006). Cell type-specific structural plasticity of axonal branches and boutons in the adult neocortex. Neuron 49, 861-875. doi: 10.1016/j.neuron.2006.02.017
19. Dobrushin, R. (1959). General formulation of shannon's main theorem in information theory. Ushepi Mat. Nauk. 14, 3-104.
20. Ebbinghaus, H. (1885). Über das GedÄchtnis: Untersuchungen zur Experimentellen Psychologie. Leipzig: Duncker & Humblot.
21. Engert, F., and Bonhoeffer, T. (1999). Dendritic spine changes associated with hippocampal long-term synaptic plasticity. Nature399, 66-70.
22. Fares, T., and Stepanyants, A. (2009). Cooperative synapse formation in the neocortex. Proc. Natl. Acad. Sci. U.S.A. 106, 16463-16468. doi: 10.1073/pnas.0813265106
23. Fauth, M., Wörgötter, F., and Tetzlaff, C. (2015a). Formation and maintenance of robust long-term information storage in the presence of synaptic turnover. PLoS Comput. Biol. 11:e1004684. doi: 10.1371/journal.pcbi.1004684
24. Fauth, M., Wörgötter, F., and Tetzlaff, C. (2015b). The formation of multi-synaptic connections by the interaction of synaptic and structural plasticity and their functional consequences. PLoS Comput. Biol. 11:e1004031. doi: 10.1371/journal.pcbi.1004031
25. Frey, U., and Morris, R. (1997). Synaptic tagging and long-term potentiation. Nature 385, 533-536.
26. Friston, K. (1994). Functional and effective connectivity. Hum. Brain Mapp. 2, 56-78.
27. Fu, M., and Zuo, Y. (2011). Experience-dependent structural plasticity in the cortex. Trends Neurosci. 34, 177-187. doi: 10.1016/j.tins.2011.02.001
28. Greene, R. (1989). Spacing effects in memory: evidence for a two-process account. J. Exp. Psychol. 15, 371-377.
29. Hebb, D. (1949). The Organization of Behavior. A Neuropsychological Theory. New York, NY: Wiley.
30. Hellwig, B. (2000). A quantitative analysis of the local connectivity between pyramidal neurons in layers 2/3 of the rat visual cortex. Biol. Cybernet. 82, 111-121. doi: 10.1007/PL00007964
31. Holtmaat, A., and Svoboda, K. (2009). Experience-dependent structural synaptic plasticity in the mammalian brain. Nat. Rev. Neurosci. 10, 647-658. doi: 10.1038/nrn2699
32. Hopfield, J. (1982). Neural networks and physical systems with emergent collective computational abilities. Proc. Natl. Acad. Sci. U.S.A. 79, 2554-2558.
33. Knoblauch, A. (2008). Neural associative memory and the Willshaw-Palm probability distribution. SIAM J. Appl. Mathemat.69, 169-196. doi: 10.1137/070700012
34. Knoblauch, A. (2009a). "The role of structural plasticity and synaptic consolidation for memory and amnesia in a model of cortico-hippocampal interplay," in Connectionist Models of Behavior and Cognition II: Proceedings of the 11th Neural Computation and Psychology Workshop, eds J. Mayor, N. Ruh and K. Plunkett (Singapore: World Scientific Publishing), 79-90.
35. Knoblauch, A. (2009b). "Zip nets: Neural associative networks with non-linear learning," in HRI-EU Report 09-03, Honda Research Institute Europe GmbH, D-63073 (Offenbach/Main).
36. Knoblauch, A. (2010a). Bimodal structural plasticity can explain the spacing effect in long-term memory tasks. Front. Neurosci. Conference Abstract: Computational and Systems Neuroscience. 2010, doi: 10.3389/conf.fnins.2010.03.00227
37. Knoblauch, A. (2010b). "Efficient associative computation with binary or low precision synapses and structural plasticity," inProceedings of the 14th International Conference on Cognitive and Neural Systems (ICCNS) (Boston, MA: Center of Excellence for Learning in Education, Science, and Technology (CELEST)), 66.
38. Knoblauch, A. (2010c). "Structural plasticity and the spacing effect in willshaw-type neural associative networks," in HRI-EU Report 10-10, Honda Research Institute Europe GmbH, D-63073 (Offenbach/Main).
39. Knoblauch, A. (2011). Neural associative memory with optimal bayesian learning. Neural Comput. 23, 1393-1451. doi: 10.1162/NECO_a_00127
40. Knoblauch, A. (2016). Efficient associative computation with discrete synapses. Neural Comput. 28, 118-186. doi: 10.1162/NECO_a_00795
41. Knoblauch, A., Hauser, F., Gewaltig, M.-O., Körner, E., and Palm, G. (2012). Does spike-timing-dependent synaptic plasticity couple or decouple neurons firing in synchrony? Front. Comput. Neurosci. 6:55. doi: 10.3389/fncom.2012.00055
42. Knoblauch, A., Körner, E., Körner, U., and Sommer, F. (2014). Structural plasticity has high memory capacity and can explain graded amnesia, catastrophic forgetting, and the spacing effect. PLoS ONE 9:e96485. doi: 10.1371/journal.pone.0096485
43. Knoblauch, A., and Palm, G. (2001). Pattern separation and synchronization in spiking associative memories and visual areas.Neural Netw. 14, 763-780. doi: 10.1016/S0893-6080(01)00084-3
44. Knoblauch, A., Palm, G., and Sommer, F. (2010). Memory capacities for synaptic and structural plasticity. Neural Comput. 22, 289-341. doi: 10.1162/neco.2009.08-07-588
45. Kononenko, I. (1989). Bayesian neural networks. Biol. Cybernet. 61, 361-370.
46. Krone, G., Mallot, H., Palm, G., and Schüz, A. (1986). Spatiotemporal receptive fields: a dynamical model derived from cortical architectonics. Proc. R. Soc. Lond. B 226, 421-444.
47. Lansner, A., and Ekeberg, O. (1989). A one-layer feedback artificial neural network with a Bayesian learning rule. Intern. J. Neural Syst. 1, 77-87.
48. Latham, P., and Nirenberg, S. (2004). Computing and stability in cortical networks. Neural Comput. 16, 1385-1412. doi: 10.1162/089976604323057434
49. Laughlin, S., and Sejnowski, T. (2003). Communication in neuronal networks. Science 301, 1870-1874. doi: 10.1126/science.1089662
50. Lennie, P. (2003). The cost of cortical computation. Curr. Biol. 13, 493-497. doi: 10.1016/S0960-9822(03)00135-0
51. Marr, D. (1971). Simple memory: a theory for archicortex. Philos. Trans. R. Soc. Lond. Ser. B 262, 24-81.
52. Martin, S., Grimwood, P., and Morris, R. (2000). Synaptic plasticity and memory: an evaluation of the hypothesis. Ann. Rev. Neurosci. 23, 649-711. doi: 10.1146/annurev.neuro.23.1.649
53. O'Connor, D., Wittenberg, G., and Wang, S.-H. (2005). Graded bidirectional synaptic plasticity is composed of switch-like unitary events. Proc. Natl. Acad. Sci. U.S.A. 102, 9679-9684. doi: 10.1073/pnas.0502332102
54. Palm, G. (1980). On associative memories. Biol. Cybernet. 36, 19-31.
55. Palm, G., Knoblauch, A., Hauser, F., and Schüz, A. (2014). Cell assemblies in the cerebral cortex. Biol. Cybernet. 108, 559-572. doi: 10.1007/s00422-014-0596-4
56. Palm, G., and Sommer, F. (1992). Information capacity in recurrent McCulloch-Pitts networks with sparsely coded memory states. Network 3, 177-186.
57. Paulsen, O., and Sejnowski, T. (2000). Natural patterns of activity and long-term synaptic plasticity. Curr. Opin. Neurobiol. 10, 172-179. doi: 10.1016/S0959-4388(00)00076-3
58. Petersen, C., Malenka, R., Nicoll, R., and Hopfield, J. (1998). All-or-none potentiation at CA3-CA1 synapses. Proc. Natl. Acad. Sci. U.S.A. 95, 4732-4737.
59. Poirazi, P., and Mel, B. (2001). Impact of active dendrites and structural plasticity on the memory capacity of neural tissue.Neuron 29, 779-796. doi: 10.1016/S0896-6273(01)00252-5
60. Raisman, G. (1969). Neuronal plasticity in the septal nuclei of the adult rat. Brain Res. 14, 25-48.
61. Schreiber, T. (2000). Measuring information transfer. Phys. Rev. Lett. 85, 461-464. doi: 10.1103/PhysRevLett.85.461
62. Schwenker, F., Sommer, F., and Palm, G. (1996). Iterative retrieval of sparsely coded associative memory patterns. Neural Netw. 9, 445-455.
63. Shannon, C., and Weaver, W. (1949). The Mathematical Theory of Communication. Urbana/Chicago: University of Illinois Press.
64. Sommer, F. (2000). On cell assemblies in a cortical column. Neurocomputing 32-33, 517-522. doi: 10.1016/S0925-2312(00)00207-1
65. Sommer, F., and Palm, G. (1999). Improved bidirectional retrieval of sparse patterns stored by Hebbian learning. Neural Netw.12, 281-297.
66. Song, S., Miller, K., and Abbott, L. (2000). Competitive Hebbian learning through spike-timing-dependent synaptic plasticity.Nature Neurosci. 3, 919-926. doi: 10.1038/78829
67. Sporns, O. (2007). Brain connectivity. Scholarpedia 2:4695. doi: 10.4249/scholarpedia.4695
68. Steinbuch, K. (1961). Die Lernmatrix. Kybernetik 1, 36-45.
69. Stepanyants, A., Hof, P., and Chklovskii, D. (2002). Geometry and structural plasticity of synaptic connectivity. Neuron 34, 275-288. doi: 10.1016/S0896-6273(02)00652-9
70. Waydo, S., Kraskov, A., Quiroga, R., Fried, I., and Koch, C. (2006). Sparse representation in the human medial temporal lobe. J. Neurosci. 26, 10232-10234. doi: 10.1523/JNEUROSCI.2101-06.2006
71. Willshaw, D., Buneman, O., and Longuet-Higgins, H. (1969). Non-holographic associative memory. Nature 222, 960-962.
72. Witte, S., Stier, H., and Cline, H. (1996). In vivo observations of timecourse and distribution of morphological dynamics in Xenopus retinotectal axon arbors. J. Neurobiol. 31, 219-234.
73. Wyner, A. (1978). A definition of conditional mutual information for arbitrary ensembles. Inform. Control 38, 51-59.
74. Xu, T., Yu, X., Perlik, A., Tobin, W., Zweig, J., Tennant, K., Jones, T., and Zuo, Y. (2009). Rapid formation and selective stabilization of synapses for enduring motor memories. Nature 462, 915-919. doi: 10.1038/nature08389
75. Yang, G., Pan, F., and Gan, W.-B. (2009). Stably maintained dendritic spines are associated with lifelong memories. Nature 462, 920-924. doi: 10.1038/nature08577
76. Yu, X., and Zuo, Y. (2011). Spine plasticity in the motor cortex. Curr. Opin. Neurobiol. 21, 169-174. doi: 10.1016/j.conb.2010.07.010