Hebbian errors in learning: An analysis using the Oja model

Journal of Theoretical Biology

Volumn 258, Issue 4, 2009, Pages 489-501

  Rǎdulescu, Anca ^a,b   Cox, Kingsley ^b,c   Adams, Paul ^b,c  

^a UNIVERSITY OF COLORADO   (United States)

^b STONY BROOK UNIVERSITY   (United States)

^c Kalypso Institute   (United States)

Author keywords

Dynamical system; Information transfer; Learning algorithm; Neural computation; Synaptic plasticity

Indexed keywords

CALCIUM;

ALGORITHM; BRAIN; ERROR ANALYSIS; LEARNING; MODELING;

ANALYTICAL ERROR; ARTICLE; DIFFUSION; LEARNING; LEARNING ALGORITHM; MOLECULAR INTERACTION; NERVE CELL; PRINCIPAL COMPONENT ANALYSIS; PRIORITY JOURNAL; QUANTITATIVE ANALYSIS; SYNAPSE; THEORETICAL MODEL;

ALGORITHMS; ANIMALS; COMPUTER SIMULATION; HUMANS; LEARNING; MODELS, NEUROLOGICAL; MODELS, PSYCHOLOGICAL; NERVE NET; NEURONAL PLASTICITY; NEURONS; SYNAPSES;

CORDEAUXIA EDULIS;

EID: 67349236369     PISSN: 00225193     EISSN: 10958541     Source Type: Journal    
DOI: 10.1016/j.jtbi.2009.01.036     Document Type: Article

References (62)

1. Adams P. Hebb and Darwin. J. Theoret. Biol. 195 (1998) 419-438
2. Adams P., and Cox K.J.A. A new view of thalamocortical function. Plos. Trans. R. Soc. London B 357 (2002) 1767-1779
3. Adams P.R., and Cox K.J.A. Synaptic Darwinism and neocortical function. Neurocomputing 42 (2002) 197-214
4. Adams P., and Cox K.J.A. A neurobiological perspective on building intelligent devices. Neuromorphic Engineer. 3 (2006) 2-10
5. Alonso J.M., Yeh C.I., Weng C., and Stoelzel C. Retinogeniculate connections: a balancing act between connection specificity and receptive field diversity. Progr. Brain Research 154 (2006) (Chapter 1)
6. Alvarez V.A., and Sabatini B.L. Anatomical and physiological plasticity of dendritic spines. Ann. Rev. Neurosci. 30 (2007) 79-97
7. Andersen P., Sundberg S.H., Sveen O., and Wigstrom H. Specific long-lasting potentiation of synaptic transmission in hippocampal slices. Nature 266 (1977) 736-773
8. Atick J., and Redlich N. Towards a theory of early visual processing. Neural Computation 2 (1990) 308-320
9. Atick J., and Redlich A.N. What does the retina know about natural scenes?. Neural Computation 4 (1992) 196-210
10. Bagal A.A., Kao J.P.Y., Tang C.-M., and Thompson S.M. Long-term potentiation of exogenous glutamate responses at single dendritic spines. Proc. Natl. Acad. Sci. USA 102 (2005) 14434-14439
11. Barbour B., Brunel N., Hakim V., and Nadal J.P. What can we learn from synaptic weight distributions?. Trends in Neurosci. 30 12 (2007) 622-629
12. Bell A.J., and Sejnowski T.J. An information maximization approach to blind separation and blind deconvolution. Neural Computation 7 (1995) 1129-1159
13. Bell A.J., and Sejnowski T.J. The 'independent components' of natural scenes are edge filters. Vision Res. 37 23 (1997) 3327-3338
14. Bi G.-Q. Spatiotemporal specificity of synaptic plasticity: cellular rules and mechanisms. Biol. Cybern. 87 (2002) 319-332
15. Bialek W. Physical limits on sensation and perception. Ann. Rev. Biophys. Chem. 16 (1987) 455-478
16. Botelho F., and Jamison J.E. A learning rule with generalized Hebbian synapses. J. Math. Anal. Appl. 273 (2002) 529-547
17. Botelho F., and Jamison J. Qualitative behavior of differential equations associated with artificial neural networks. J. Dyn. Differential Equations 16 (2004) 179-204
18. Chen C., and Regehr W.G. Developmental remodeling of the retinogeniculate synapse. Neuron 28 (2000) 955-966
19. Cox K.J.A., and Adams P.R. Implications of synaptic digitisation and error for neocortical function. Neurocomputing 32-33 (2000) 673-678
20. Diamantaras K.I., and Kung S.-Y. Principal Component Neural Networks: Theory and Applications (1996), Wiley, New York
21. Eigen M., McCaskill J., and Schuster P. The molecular quasispecies. Adv. Chem. Phys. 75 (1989) 149-163
22. Elman J., Bates E.A., Johnson M.H., Karmiloff-Smith A., Parisi D., and Plunkett K. Rethinking Innateness: A Connectionist Perspective on Development (1996), MIT Press, Cambridge
23. Engert F., and Bonhoeffer T. Synapse specificity of long-term potentiation breaks down at short distances. Nature 388 (1997) 279-284
24. Grutzendler J., Kasthuri N., and Gan W.B. Long-term dendritic spine stability in the adult cortex. Nature 420 (2002) 812-816
25. Gerstner W., and Kistler W.M. Spiking Neuron Models (2002), Cambridge University Press, Cambridge
26. Harvey C.D., and Svoboda K. Locally dynamic synaptic learning rules in pyramidal neuron dendrites. Nature 450 (2007) 1195-1200
27. Hebb D.O. The Organization of Behavior (1949), Wiley, New York
28. Hertz J., Krogh A., and Palmer R.G. Introduction to the Theory of Neural Computation. Lecture Notes Volume in the Santa Fe Institute for Studies in the Sciences of Complexity (1991), Perseus Books Publishing
29. Holtmaat A.J., et al. Transient and persistent dendritic spines in the neocortex in vivo. Neuron 45 (2005) 279-291
30. Hyvarinen A., Karhunen J., and Oja E. Independent Component Analysis (2001), Wiley Interscience, New York
31. Kahn P.B. Mathematical Methods for Scientists and Engineers (1990), Wiley Interscience, New York
32. Kopec C.D., Li B., Wei W., Boehm J., and Malinow R. Glutamate receptor exocytosis and spine enlargement during chemically induced long-term potentiation. J. Neurosci. 26 7 (2006) 2000-2009
33. Le Be J.V., and Markram H. Spontaneous and evoked synaptic rewiring in the neonatal neocortex. Proc. Natl. Acad. Sci. USA 103 (2006) 13214-13219
34. Lendvai B., Stern E.A., Chen B., and Svoboda K. Experience-dependent plasticity of dendritic spines in the developing rat barrel cortex in vivo. Nature 404 (2000) 876-881
35. Levy W.B., and Steward O. Synapses as associative memory elements in the hippocampal formation. Brain Res. 175 (1979) 233-245
36. Lisman J. A mechanism for the Hebb and the anti-Hebb processes underlying learning and memory. Proc. Natl. Acad. Sci. USA 86 (1989) 9574-9578
37. Lisman, J., Raghavachari, L., 2007. A unified model of the presynaptic and postsynaptic changes during LTP at CA1 synapses. Science's STKE.
38. Llinas R.R., and Walton K.D. Cerebellum. In: Shepherd G.M. (Ed). The Synaptic Organization of the Brain (1998), Oxford University Press, Oxford 255-288
39. Markram H., Luebke J., Frotscher M., and Sakmann B. Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science 275 (1997) 213-215
40. Markram H., Luebke J., Frotscher M., Roth A., and Sakmann B. Physiology and anatomy of synaptic connections between thick tufted pyramidal neurones in the developing rat neocortex. J. Physiol. 500 (1997) 409-440
41. Matsuzaki M., Honkura N., Ellis-Davies G.C., and Kasai H. Structural basis of long-term potentiation in single dendritic spines. Nature 429 (2004) 761-766
42. Nowak M.A., and Schuster P. Error thresholds of replication in finite populations-mutation frequencies and the onset of Muller's ratchet. J. Theoret. Biol. 137 (1989) 375-395
43. O'Connor D.H., Wittenberg G.M., and Wang S.S.-H. Graded bidirectional synaptic plasticity is composed of switch-like unitary events. Proc. Natl. Acad. Sci. USA 102 27 (2005) 9679-9684
44. Oja E. A simplified neuron model as a principal component analyzer. J. Math. Biol. 15 (1982) 267-273
45. Oja E., and Karhunen J. On stochastic approximation of the eigenvectors and eigenvalues of the expectation of a random matrix. J. Math. Anal. Appl. 106 (1985) 69-84
46. Orgel L. The origin of life on earth. Scientific American 271 4 (1994) 81
47. Petersen C.C.H., Malenka R.C., Nicoll R.A., and Hopfield J.J. All-or-none potentiation at CA3-CA1 synapses. Proc. Natl. Acad. Sci. USA 95 (1998) 4732-4737
48. Rumsey C.C., and Abbott L.F. Equalization of synaptic efficacy by activity- and timing-dependent synaptic plasticity. J. Neurophysiol. 91 5 (2004)
49. Schuman E.M., and Madison D.V. Locally distributed synaptic potentiation in the hippocampus. Science 263 (1994) 532-536
50. Shatz C.J. Emergence of order in visual system development. Proc. Natl. Acad. Sci. USA 93 (1996) 602-608
51. Sherman S.M. The thalamus is more than just a relay. Curr. Opin. Neurobiol. 17 4 (2007) 417-422
52. Sherman S.M., and Guillery R.W. Exploring the Thalamus (2001), Academic Press, San Diego
53. Srinivasan M.V., Laughlin S.B., and Dubs A. Predictive coding: a fresh view of inhibition in the retina. Proc. R. Soc. Lond. B Biol. Sci. 216 1205 (1982) 427-459
54. Stepanyants A., Hof P., and Chklovskii D. Geometry and structural plasticity of synaptic connectivity. Neuron 34 2 (2002) 275-288
55. Stepanyants A., Hirsch J.A., Martinez L.M., Kisvarday Z.F., Ferecsko A.S., and Chklovskii D.B. Local potential connectivity in cat primary visual cortex. Cereb. Cortex 18 1 (2008) 13-28
56. Swetina P., and Schuster P. Self-replication with error-a model for polynucleotide replication. Biophys. Chem. 16 (1982) 329-345
57. Tao H.W., Zhang L.I., Engert F., and Poo M. Neuron 31 4 (2001) 569-580
58. Tarazona P. Error threshold for molecular quasispecies as phase transitions: from simple landscapes to spin-glass models. Phys. Rev. A 45 (1992) 6038-6050
59. Volkenstein M.V. Physical Approaches to Biological Evolution (1994), Springer, Berlin
60. Wilson J.R., Friedlander M.J., and Sherman S.M. Fine structural morphology of identified X- and Y-cells in the cat's lateral geniculate nucleus. Proc. R. Soc. B 221 (1984) 411-436
61. Wyatt Jr. J.L., and Elfadel I.M. Time-domain solutions of Oja's equations. Neural Computation 7 5 (1995) 915-922
62. Zador A., and Koch C. Linearized models of calcium dynamics: formal equivalence to the cable equation. J. Neurosci. 14 (1994) 4705-4715