Neurons with two sites of synaptic integration learn invariant representations

Neural Computation

Volumn 13, Issue 12, 2001, Pages 2823-2849

  Körding, Konrad P ^a   König, Peter ^a  

^a Institute of Neuroinformatics Zurich   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ANIMAL; ARTICLE; BIOLOGICAL MODEL; CALCIUM SIGNALING; COMPARATIVE STUDY; CYTOLOGY; DENDRITE; LEARNING; MAMMAL; NEOCORTEX; NERVE CELL; PHYSIOLOGY; PYRAMIDAL NERVE CELL; SYNAPSE; TEMPORAL LOBE; ULTRASTRUCTURE; VISUAL CORTEX;

ALGORITHMS; ANIMALS; CALCIUM SIGNALING; DENDRITES; LEARNING; MAMMALS; MODELS, NEUROLOGICAL; NEOCORTEX; NEURONS; PYRAMIDAL CELLS; SYNAPSES; TEMPORAL LOBE; VISUAL CORTEX;

EID: 0035653997     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/089976601317098547     Document Type: Article

References (65)

1. Amitai, Y., Friedman, A., Connors, B. W., & Gutnick, M. J. (1993). Regenerative activity in apical dendrites of pyramidal cells in neocortex. Cereb. Cortex, 3, 26-38.
2. Artola, A., Bröcher, S., & Singer, W. (1990). Different voltage-dependent thresholds for inducing long-term depression and long-term potentiation in slices of rat visual cortex. Nature, 347, 69-72.
3. Barnard, E., & Casasent, D. P. (1991). Invariance and neural nets. IEEE Transactions on Neural Networks, 2, 489-508.
4. Becker, S. (1996). Models of cortical self-organisation. Network: Comput. Neural Syst., 7, 7-31.
5. Becker, S. (1999). Implicit learning in 3D object recognition: The importance of temporal context. Neur. Comput., 11, 347-374.
6. Becker, S., & Hinton, G. E. (1992). Self-organizing neural network that discovers surfaces in random-dot stereograms. Nature, 355, 161-163.
7. Bernander, O., Koch, C., & Douglas, R. J. (1994). Amplification and linearization of distal synaptic input to cortical pyramidal cells. J. Neurophysiol., 72, 2743-2753.
8. Betsch, B. Y., Einhäuser, W., Körding, P. K., & König, P. (2001). What a cat sees -statistics of natural videos. Manuscript submitted for publication.
9. Bishop, C. M. (1995). Neural networks for pattern recognition. Oxford: Oxford University Press.
10. Booth, M. C., & Rolls, E. T. (1998). View-invariant representations of familiar objects by neurons in the inferior temporal visual cortex. Cereb. Cortex, 8, 510-523.
11. Bradski G., & Grossberg, S. (1995). Fast-learning viewnet architectures for recognizing three-dimensional objects from multiple two-dimensional views. Neural Networks, 8, 1053-1800.
12. Braitenberg, V. (1978). Cortical architectonics: General and areal. In M. A. B. Brezier & H. Petsch (Eds.), Architectonics of the cerebral cortex. New York: Raven.
13. Buzsaki, G., & Kandel, A. (1998). Somadendritic backpropagation of action potentials in cortical pyramidal cells of the awake rat. J. Neurophysiol, 79, 1587-1591.
14. Cash, S., & Yuste, R. (1999). Linear summation of excitatory inputs by CA1 pyramidal neurons. Neuron, 22, 383-394.
15. Cauller, L. J., & Connors, B. W. (1994). Synaptic physiology of horizontal afferents to layer I in slices of rat SI neocortex. J. Neurosci., 14, 751-762.
16. de Sa, V. R. & Ballard, D. H. (1998) Category learning through multimodality sensing. Neur. Comp., 10, 1097-1117.
17. Dudek, S. M., & Bear, M. F. (1991). Homosynaptic long term depression in area CAl of hippocampus and the effects on NMDA receptor blockade. Proc. Natl. Acad. Sci. U.S.A., 89, 4363-4367.
18. Eisele, M. (1997). Unsupervised learning of temporal constancies by pyramidal-type neurons. In S.W. Ellacon, J. C. Mason, & I.J. Anderson (Eds.), Mathematics of neural networks (pp. 171-175). Norwell, MA: Kluwer.
19. Felleman, D., & Van Essen, D. C. (1991). Distributed hierarchical processing in the primate cerebral cortex. Cereb. Cortex, 1, 1-47.
20. Földiak, P. (1991). Learning invariance from transformation sequences. Neural Comput., 3, 194-200.
21. Fukushima, K. (1980). Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol. Cybern., 36, 193-202.
22. Fukushima, K. (1988). Neocognitron: A hierarchical neural network capable of visual pattern recognition. Neural Networks, 1, 119-130.
23. Fukushima, K. (1999). Self-organization of shift-in variant receptive fields. Neural Networks, 12, 791-801.
24. Graziano, M. S., & Gross, C. G. (1998). Spatial maps for the control of movement. Curr. Opin. Neurobiol., 8, 195-201.
25. Hebb, D. O. (1949). The organisation of behaviour. New York: Wiley.
26. Helmchen, F., Svoboda, K., Denk, W., & Tank, D. W. (1999). In vivo dendritic calcium dynamics in deep-layer cortical pyramidal neurons. Nat. Neurosci., 2, 989-996.
27. Hinton, G. E. (1987). Learning translation invariant recognition in a massively parallel network. In G. Goos & J. Hartmanis (Eds.), PARLE: Parallel architectures and languages Europe (pp. 1-13) Berlin: Springer-Verlag.
28. Hinton, G. E. (1989). Connectionist learning procedures. Artificial Intelligence, 40, 185-234.
29. Hirsch, J. A., Alonso, J. M., & Reid, R. C. (1995). Visually evoked calcium action potentials in cat striate cortex. Nature, 378, 612-616.
30. Hubel, D. H., & Wiesel, T. N. (1962). Receptive fields, binocular interaction and functional architecture in the cat's visual cortex. J. Physiol., 160, 106-154.
31. Hubel, D. H., & Wiesel, T. N. (1998). Early exploration of the visual cortex. Neuron, 20, 401-412.
32. Hyvarinen, A., & Hoyer, P. O. (2000). Emergence of phase and shift invariant features by decomposition of natural images into independent feature subspaces. Neural Comput., 12, 1705-1720.
33. Johnston D., Magee, J. C., Colbert, C. M., & Cristie, B. R. (1996). Active properties of neuronal dendrites. Ann. Rev. Neurosci., 19, 165-186.
34. Kay, J., Floreano, D., & Phillips, W. A. (1998). Contextually guided unsupervised learning using local multivariate binary processors. Neural Networks, 11, 117-140.
35. Kim, U., Sanchez-Vives, M. V., & McCormick, D. A. (1997). Functional dynamics of GABAergic inhibition in the thalamus. Science, 278, 130-134.
36. Kobatake E., & Tanaka K. (1994). Neuronal selectivities to complex object features in the ventral visual pathway of the macaque cerebral cortex. J. Neurophysiol., 71, 856-867.
37. König, P., Engel, A. K., Roelfsmar, P. R., & Singer, W. (1995). How precise is neuronal synchronization? Neural Comp., 7, 469-485.
38. Körding, K. P., & König, P. (2000a). Learning with two sites of synaptic integration. Network: Comput. Neural Syst., 11, 1-15.
39. Körding, K. P., & König, P. (2000b). A learning rule for dynamic recruitment and decorrelation. Neural Networks, 13, 1-9.
40. Larkum, M. E., Kaiser, K. M., & Sakmann, B. (1999). Calcium electrogenesis in distal apical dendrites of layer 5 pyramidal cells at a critical frequency of backpropagating action potentials. Proc. Natl. Acad. Sci. USA, 96, 14600-14604.
41. Larkum, M. E., Zhu, J. J., & Sakmann, B. (1999). A new cellular mechanism for coupling inputs arriving at different cortical layers. Nature, 398, 338-341.
42. Le Cun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E, Hubbard, W., & Jackel, L. D. (1989). Backpropagation applied to handwritten zip code recognition. Neural Comput., 1, 541-551.
43. Markram, H., Lübke, J., Frotscher, M., & Sakmann, B. (1997). Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science, 275, 213-215.
44. Mel, B. W. (1993). Synaptic integration in an excitable dendritic tree. J. Neurophysiol., 70, 1086-1101.
45. Mel, B. W., Ruderman, D. L., & Archie, K. A. (1998). Translation-invariant tuning in visual "complex" cells could derive from intradendritic computations. J. Neurosci., 18, 4325-4334.
46. O'Reilly, R. C., & Johnson, M. H. (1994). Object recognition and sensitive periods: A computational analysis of visual imprinting. Neur. Comp., 6, 357-389.
47. Perrett, D. I., Oram, M. W., Harries, M. H., Bevan, R., Hietanen, J. K., Venson, P. J., & Thomas, S. (1991). Viewer-centred and object-centred coding of heads in the macaque temporal cortex. Exp. Brain. Res., 86, 159-173.
48. Phillips, W. A., Kay, J., & Smyth, D. (1995). The discovery of structure by multi-stream networks of local processors with contextual guidance. Network: Comput. Neural Syst., 6, 225-246.
49. Pike, F. G., Meredith, R. M., Olding, A. W. A., & Paulsen O. (1999). Postsynaptic bursting is essential for "Hebbian" induction of associative long-term potentiation at excitatory synapses in rat hippocampus. J. Phys., 518, 571-576.
50. Rao, R., & Sejnowski, T. J. (2000). Predictive sequence learning in recurrent neocortical circuits. In S. A. Solla, T. K. Leen, & K.-R. Müller (Eds.).
51. Riesenhuber, M., & Poggio, T. (1999). Hierarchical models of object recognition in cortex. Nat. Neurosci., 2, 1019-1025.
52. Rolls, E. (1992). Neurophysiological mechanisms underlying face processing within and beyond the temporal cortical visual areas. Phil. Trans. R. Soc. Lond. B, 335, 11-21.
53. Rolls, E., & Treves, A. (1997). Neural networks and brain function. Oxford: Oxford University Press.
54. Salin, P. A., & Bullier, J. (1995). Corticocortical connections in the visual system: Structure and function. Physiol. Rev., 75, 107-154.
55. Schiller, J., Schiller, Y., Stuart, G., & Sakmann, B. (1997). Calcium action potentials restricted to distal apical dendrites of rat neocortical pyramidal neurons. J. Physiol. (Lond.), 505, 605-616.
56. Segev, I., & Rall, W. (1998) Excitable dendrites and spines: Earlier theoretical insights elucidate recent direct observations. Trends Neurosci., 21, 453-460.
57. Siegel, M., Körding, K. P., & König, P. (2000). Integrating bottom-up and top-down sensory processing by somato-dendritic interactions. J. Comput. Neurosci., 8, 161-173.
58. Softky, W. (1994). Sub-millisecond coincidence detection in active dendritic trees. Neuroscience, 58, 13-41.
59. Stone, J. V., & Bray A. J. (1995). A learning rule for extracting spatio-temporal invariances. Network: Comput. Neural Syst., 6, 429-436.
60. Stuart, G. J., & Sakmann, B. (1994). Active propagation of somatic action potentials into neocortical pyramidal cell dendrites. Nature, 367, 69-72.
61. Stuart, G. T., Schiller, J., & Sakmann, B. (1997). Action potential initiation and propagation in rat neocortical pyramidal neurons. J. Physiol. (Lond.), 505, 617-632.
62. Stuart, G. J., & Spruston, N. (1998). Determinants of voltage attenuation in neocortical pyramidal neuron dendrites. J. Neurosci., 18, 3501-3510.
63. Wang, G., Tanaka, K., & Tanifuji, M. (1996). Optical imaging of functional organization in the monkey inferotemporal cortex. Science, 272, 1665-1668.
64. Williams, S. R., & Stuart G. J. (1999). Mechanisms and consequences of action potential burst firing in rat neocortical pyramidal neurons. J. Physiol. (Lond.), 521, 467-482.
65. Zeki, S., & Shipp, S. (1988). The functional logic of cortical connections. Nature, 335, 311-317.