Hebbian crosstalk prevents nonlinear unsupervised learning

Frontiers in Computational Neuroscience

Volumn 3, Issue SEP, 2009, Pages

  Cox, Kingsley J A ^a,b   Adams, Paul R ^a,b  

^a STONY BROOK UNIVERSITY   (United States)

^b Kalypso Institute   (United States)

Author keywords

Cortex; Hebbian learning; ICA; LTP; LTP crosstalk; Synaptic plasticity

Indexed keywords

CORTEX; HEBBIAN LEARNING; HIGHER ORDER CORRELATION; INDEPENDENT COMPONENTS ANALYSIS; LTP; QUALITATIVE CHANGES; SYNAPTIC CONNECTIONS; SYNAPTIC PLASTICITY;

INDEPENDENT COMPONENT ANALYSIS;

CROSSTALK;

EID: 84856366294     PISSN: 16625188     EISSN: None     Source Type: Journal    
DOI: 10.3389/neuro.10.011.2009     Document Type: Article

References (80)

1. Adams, P., and Cox, K. J. A. (2002a). A new view of thalamocortical function. Philos. Trans. R. Soc. Lond. B. 357, 1767-1779.
2. Adams, P. R., and Cox, K. J. A. (2002b). Synaptic darwinism and neocortical function. Neurocomputing. 42, 197-214.
3. Adams, P. R., and Cox, K. J. A. (2006). A neurobiological perspective on building intelligent devices. Neuromorphic Eng. 3: 2-8 Available at: http://www.ine-news.org/view. php?source=0036-2006-05-01.
4. Amari, S.-I. (1998). Natural gradient works efficiently in learning. Neural Comput. 10, 251-276.
5. Amari, S.-I., Chen, T.-P., and Cichocki, A. (1997). Stability analysis of adaptive blind source separation. Neural Netw. 10,1345-1351.
6. Amari, S.-I., Cichocki, A., and Yang, H. H. (1996). A new learning algorithm for blind signal separation. Adv. Neural Inf. Process. Syst. 8, 757-763.
7. Andersen, P., Sundberg, S. H., Sveen, O., and Wigstrom, H. (1977). Specific long-lasting potentiation of synaptic transmission in hippocampal slices. Nature 266, 736-737.
8. Atick, J., and Redlich, A. N. (1990). Towards a theory of early visual processing. Neural Comput. 2, 308-320.
9. Atick, J. J., and Redlich, A. N. (1992). What does the retina know about natural scenes? Neural Comput. 4, 196-210.
10. Bell, A., and Sejnowski, T. (1997). The 'independent components' of natural scenes are edge filters. Vision Res. 37, 3327-3338.
11. Bell, A. J., and Sejnowski, T. J. (1995). An information maximization approach to blind separation and blind deconvolution. Neural Comput. 7, 1129-1159.
12. Bi, G.-Q., (2002). Spatiotemporal specificity of synaptic plasticity: cellular rules and mechanisms. Biol. Cybern. 87, 319-332.
13. Binzegger, T., Douglas, R. J., and Martin, K. A. (2004). A quantitative map of the circuit of cat primary visual cortex. J. Neurosci. 24, 8441-8453.
14. Bloodgood, B. L., and Sabatini, B. S. (2005). Neuronal activity regulates diffusion across the neck of dendritic spines. Science 310:866-869.
15. Bonhoeffer, T., Staiger, V., and Aertsen, A. (1994). Synaptic plasticity in rat hippocampal slice cultures: local Hebbian conjunction of pre-and postsynaptic stimulation leads to distributed synaptic enhancement. Proc. Natl. Acad. Sci. U.S.A. 86: 8113-8117.
16. Botelho, F., and Jamison, J. (2004). Qualitative behavior of differential equations associated with artificial neural networks. J. Dyn. Differ. Equ. 16: 179-204.
17. Chevaleyre, V., and Castillo, P. E. (2004). Endocannabinoid-mediated metaplasticity in the hippocampus. Neuron 43, 871-881.
18. Chklovskii, D. B., Mel, B. W., and Svoboda, K. (2004). Cortical rewiring and information storage. Nature 431: 782-788.
19. Cooper, L. N., Intrator, N., Blaise, B. S., and Shouval, H. Z. (2004). Theory of Cortical Plasticity. World Scientific, London.
20. Cornelisse, L. N., van Elburg, R. A. J., Meredith, R. M., Yuste, R., and Mansvelder, H. D. (2007). High speed two-photon imaging of calcium dynamics in dendritic spines: consequences for spine calcium kinetics and buffer capacity. PLoS One 2, e1073. doi: 10.1371/journal. pone.0001073.
21. Cox, K. J. A., and Adams, P. R. (2000). Implications of synaptic digitisation and error for neocortical function. Neurocomputing 32-33, 673-678.
22. Dan, Y., and Poo, M.-M. (2004). Spike timing-dependent plasticity of neural circuits. Neuron 44, 23-30.
23. Dayan, P., and Abbott, L. E. (2001). Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems. Cambridge MA, MIT Press.
24. 2+ scillations. Science 279, 227-230.
25. DeFelipe, J., Marco, P., Busturia, I., and Merchán-Pérez, A. (1999). Estimation of the number of synapses in the cerebral cortex: methodological considerations. Cereb. Cortex 9, 722-732.
26. 2+ calmodulin-kinase II enhances channel conductance of e-amino-3-hydroxy-5-methyl-4-isoxazolepropionate type glutamate receptors. Proc. Natl. Acad. Sci. U.S.A. 96. 3269-3274.
27. Eigen, M. (1985). Steps Toward Life. Oxford, Oxford University Press.
28. Eigen, M., McCaskill, J., and Schuster, P. (1989). The molecular quasispecies. Adv. Chem. Phys. 75, 149-163.
29. Engert, F., and Bonhoeffer, T. (1997). Synapse specificity of long-term potentiation breaks down at short distances, Nature 388, 279-284.
30. Feng, D., Marshburn, D., Jen, D., Weinberg, R. J., Taylor, R. M., and Burette, A. (2007). stepping into the third dimension. J. Neurosci. 27, 12757-12760.
31. Harvey, C. D., and Svoboda, K. (2007). Locally dynamic synaptic learning rules in pyramidal neuron dendrites. Nature 450, 1195-1200.
32. Harvey, C. D., Yasuda, R., Zhong, H., and Svoboda, K. (2008). The spread of ras activity triggered by activation of a single dendritic spine. Science 321, 136-140.
33. Hausser, M., and Mel, B. (2003). Dendrites: bug or feature? Curr. Opin. Neurobiol. 13, 372-383.
34. Haykin, S. (1994). Neural Networks: A Comprehensive Foundation. New York, Macmillan.
35. Herz, J., Krogh, A., and Palmer, R. G. (1991). Introduction to the Theory of Neural Computation. Lecture Notes Volume in the Santa Fe Institute Studies in the Sciences of Complexity. Cambridge, MA, Perseus Books.
36. Hoyer, P. O., and Hyvärinen, A. (2000). Independent component analysis applied to feature extraction from colour and stereo images. Network 11, 191-210.
37. Hyvärinen, A., and Hoyer, P. O. (2000). Emergence of phase and shift invariant features by decomposition of natural images into independent feature subspaces. Neural Comput. 12, 1705-1720.
38. Hyvärinen, A., Karhunen, J., and Oja, E. (2001). Independent Component Analysis. Wiley Interscience, New York.
39. Hyvarinen, A., and Oja, E. (1998). Independent component analysis by general non-linear Hebbian-like learning rules. Signal Process. 64, 301-313.
40. Izhikevich, E. M. (2007). Dynamical Systems in Neuroscience: The Geometry of Excitability and Bursting. The MIT press, Cambridge, MA.
41. Kalisma, N., Silberberg, G., and Markram, H., (2005). The neocortical microcircuit as a tabula rasa. Proc. Natl. Acad. Sci. U.S.A. 102, 880-885.
42. Kampa, B. M., Clements, J., Jonas, P., and Stuart, G. J. (2004). Kinetics of Mg22 unblock of NMDA receptors: implications for spike-timing dependent synaptic plasticity. J. Physiol. 556, 337-345.
43. Keck, T., Mrsic-Flogel, T. D., Vaz Afonso, M., Eysel, U. T., Bonhoeffer, T., and Hübener, M. (2008). Massive restructuring of neuronal circuits during functional reorganization of adult visual cortex. Nat. Neurosci. 11, 1162-1167.
44. Koch, C. (2004). Biophysics of Computation. Oxford University Press, New York.
45. Koch, C., and Zador, A. (1993). The function of dendritic spines: devices subserving biochemical rather than electrical compartmentalization. J. Neurosci. 13, 413-422.
46. Korkotian, E., Holcman, D., and Segal, M. (2004). Dynamic regulation of spine-dendrite coupling in cultured hippocampal neurons. Eur. J. Neurosci. 20, 2649-2663.
47. Kossel, A., Bonhoeffer, T., and Bolz, J. (1990). Non-Hebbian synapses in rat visual cortex. Neuroreport 1, 115-118.
48. Larkum, M. E., and Nevian, T. (2008). Synaptic clustering by dendritic signalling mechanisms. Curr. Opin. Neurobiol. 18, 321-331.
49. Le Be, J. V., and Markram, H., (2006). Spontaneous and evoked synaptic rewiring in the neonatal neocortex. Proc. Natl. Acad. Sci. U.S.A. 103, 13214-13219.
50. Leuthausser, I., (1986). An exact correspondence between Eigen's evolution model and two-dimensional Ising system. J. Chem. Phys. 84, 1880-1885.
51. Levy, W. B., and Steward, O. (1979). Synapses as associative memory elements in the hippocampal formation. Brain Res. 175, 233-245.
52. Lisman, J. (1989). A mechanism for the Hebb and the anti-Hebb processes underlying learning and memory. Proc. Natl. Acad. Sci. U.S.A. 86, 9574-9578.
53. Lisman, J. (1990). The CaM kinase II hypothesis for the storage of synaptic memory. Trends Neurosci. 17, 406-412.
54. Lisman, J., Schulman, H., and Cline, H. (2002). The molecular basis of CaMKII function in synaptic and behavioral memory. Nat. Rev. Neurosci. 3, 175-190.
55. Majewska, A., Brown, E., Ross, J., and Yuste, R. (2000). Mechanisms of calcium decay kinetics in hippocampal spines: role of spine calcium pumps and calcium diffusion through the spine neck in biochemical compartmentalization. J. Neurosci. 20, 1722-1734.
56. Markram, H., Lübke, J., Frotscher, M., Roth, A., and Sakmann, B. (1997). Physiology and anatomy of synaptic connections between thick tufted pyramidal neurones in the developing rat neocortex. J. Physiol. 500, 409-440.
57. Matsuzaki, M., Honkura, N., Ellis-Davies, G. C., and Kasai, H. (2004). Structural basis of long-term potentiation in single dendritic spines. Nature 429, 761-766.
58. 2+ responses. Nature 354, 73-75.
59. Nadal, J.-P., and Parga, N. (1994). Nonlinear neurons in the low-noise limit: a factorial code maximizes information transfer. Network 5, 565-581.
60. Nevian, T., Larkum, M. E., Polsky, A., and Schiller, J. (2007). Properties of basal dendrites of layer 5 pyramidal neurons: a direct patch-clamp recording study. Nat. Neurosci. 10, 206-214.
61. 2+ Signals evoked by coincident EPSPs and backpropagating action potentials in spiny stellate cells of layer 4 in the juvenile rat somatosensory barrel cortex. J. Neurosci. 24, 1689-1699.
62. Nimchinsky, E. A., Sabatini, B. L., and Svoboda, K. (2002). Structure and function of dendritic spines. Ann. Rev. Physiol. 64, 313-353.
63. 2+ signaling in dendrites. Neuron 46, 609-622.
64. O'Connor, D. H., Wittenberg, G. M., and Wang, S. S.-H. (2005). Graded bidirectional synaptic plasticity is composed of switch-like unitary events. Proc. Natl. Acad. Sci. U.S.A. 102, 9679-9684.
65. Oja, E. (1982). A simplified neuron model as a principal component analyzer. J. Math. Biol. 15, 267-273.
66. Olshausen, B. A., and Field, D. J. (2004). Sparse coding of sensory inputs. Curr. Opin. Neurobiol. 14, 481-487.
67. Petersen, C. C., Malenka, R. C., Nicoll, R. A., and Hopfield, J. J. (1998). All-or-none potentiation at CA3-CA1 synapses. Proc. Natl. Acad. Sci. U.S.A. 95, 4732-4737.
68. Polsky, A., Mel, B. W., and Schiller, J. (2008). Computational subunits in thin dendrites of pyramidal cells. Nat. Neurosci. 7, 621-627.
69. Radulescu, A. R., Cox, K. J. A., and Adams, P. R. (2009). Hebbian errors in learning: an analysis using the Oja model. J. Theor. Biol. 258, 489-501.
70. 2+ yions in dendritic spines. Neuron 33, 439-452.
71. Schuman, E. M., and Madison, D. V. (1994). Locally distributed synaptic potentiation in the hippocampus. Science 263, 532-536.
72. Srinivasan, M. V., Laughlin, S. B., and Dubs, A. (1982). Predictive coding: a fresh view of inhibition in the retina. Proc. R. Soc. Lond. B. Biol. Sci. 216, 427-459.
73. Stepanyants, A., Hof, P., and Chklovskii, D. (2002). Geometry and structural plasticity of synaptic connectivity. Neuron 34, 275-288.
74. Strogatz, S. G. (2001). Nonlinear Dynamics and Chaos: With Applications to Physics, Biology, Chemistry and Engineering. Cambridge, MA, Perseus.
75. Swetina, P., and Schuster, P. (1982). Selfreplication with errors. A model for polynucleotide replication. Biophys. Chem. 16, 329-345.
76. Tao, H. W., Zhang, L. I., Engert, F., and Poo, M.-M. (2001). Emergence of input specificity of LTP during development of retinotectal connections in vivo. Neuron 31, 569-580.
77. van Hateren, J. H., and Ruderman, D. L. (1998). Independent component analysis of natural image sequences yields spatiotemporal filters similar to simple cells in primary visual cortex. Proc. Royal Soc. 265, 2315-2320.
78. van Hateren, J. H., and van der Schaaf, A. (1998). Independent component filters of natural images compared with simple cells in primary visual cortex. Proc. Biol. Sci. 265, 359-366.
79. Wickens, J. (1988). Electrically coupled but chemically isolated synapses: dendritic spines and calcium in a rule for synaptic modification. Prog. Neurobiol. 31, 507-528.
80. Zador, A., and Koch, C. (1994). Linearized models of calcium dynamics: formal equivalence to the cable equation. J. Neurosci. 14, 4705-4715.