Learning the invariance properties of complex cells from their responses to natural stimuli

European Journal of Neuroscience

Volumn 15, Issue 3, 2002, Pages 475-486

  Einhäuser, Wolfgang ^a   Kayser, Christoph ^a   König, Peter ^a   Körding, Konrad P ^a  

^a UNIVERSITY OF ZURICH   (Switzerland)

Author keywords

Development; Primary visual cortex; Temporal continuity; Unsupervised learning

Indexed keywords

ANIMAL EXPERIMENT; ARTICLE; BRAIN CORTEX; CAMERA; CAT; CONTROLLED STUDY; DEVELOPMENT; LEARNING; NONHUMAN; PRIORITY JOURNAL; RECEPTIVE FIELD; STIMULUS; STIMULUS RESPONSE; VIDEORECORDING; VISUAL SYSTEM;

ANIMALS; CATS; EVOKED POTENTIALS, VISUAL; LEARNING; MODELS, NEUROLOGICAL; NERVE NET; NEURAL NETWORKS (COMPUTER); NEURONS; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; SYNAPTIC TRANSMISSION; VIDEO RECORDING; VISUAL CORTEX; VISUAL FIELDS;

EID: 0036458394     PISSN: 0953816X     EISSN: None     Source Type: Journal    
DOI: 10.1046/j.0953-816x.2001.01885.x     Document Type: Article

References (56)

1. Alonso, J.M. & Martinez, L.M. (1998) Functional connectivity between simple cells and complex cells in cat striate cortex. Nature Neurosci., 1, 395-403.
2. Artola, A., Brocher, S. & Singer, W. (1990) Different voltage-dependent thresholds for inducing long-term depression and long-term potentiation in slices of rat visual cortex. Nature, 347, 69-72.
3. Bear, M.F. & Malenka, R.C. (1994) Synaptic plasticity: LTP and LTD. Curr. Opin. Neurobiol., 4, 389-399.
4. Becker, S. (1996) Mutual information maximization: Models of cortical self-organization. Network, 7, 7-31.
5. Becker, S. (1999) Implicit learning in 3D object recognition: The importance of temporal context. Neural Computation, 11, 347-374.
6. Bell, A.J. & Sejnowski, T.J. (1997) The 'independent components' of natural scenes are edge filters. Vision Res., 37, 3327-3338.
7. Betsch, B.Y., Körding, K.P. & König, P. (2001) The visual environment of cats. Annual Meeting of the Assoc. for Research in Vision and Ophthalmology, Fort Lauderdale, 3308, 615.
8. Bi, G.Q. & Poo, M.M. (1998) Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. J. Neurosci., 18, 10464-10472.
9. Chance, F.S., Nelson, S.B. & Abott, L.F. (1999) Complex cells as cortically amplified simple cells. Nature Neurosci., 2, 277-282.
10. De Valois, R.L., Albrecht, D.G. & Thorell, L.G. (1982) Spatial frequency selectivity of cells in Macaque visual cortex. Vision. Res., 22, 545-559.
11. Debanne, D., Gähwiler, B.H. & Thompson, S.M. (1996) Cooperative interactions in the induction of long-term potentiation and depression of synaptic excitation between hippocampal CA3-CA1 cell pairs in vitro. Proc. Natl. Acad. Sci. USA, 93, 11225-11230.
12. Douglas, R.J. & Martin, K.A.C. (1991) A functional microcircuit for cat visual cortex. J. Physiol. (Lond.), 440, 735-769.
13. Ellias, S.A. & Grossberg, S. (1975) Pattern formation, contrast control and oscillations in the short term memory of shunting on-center off-surround networks. Biol. Cybern., 20, 69-98.
14. Ferster, D. & Lindstrom, S. (1983) An intracellular analysis of geniculocortical connectivity in area 17 of the cat. J. Physiol. (Lond.), 342, 181-215.
15. Földiak, P. (1991) Learning invariance from transformation sequences. Neural Comput., 3, 194-200.
16. Fukushima, K. (1980) Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol. Cybern., 36, 193-202.
17. Guitton, D., Douglas, R.M. & Volle, M. (1984) Eye-head coordination in cats. J. Neurophysiol., 52, 1030-1050.
18. van Hateren, J.H. & van der Schaaf, A. (1998) Independent component filters of natural images compared with simple cells in primary visual cortex. Proc. R. Lond. B., 265, 359-366.
19. Hertz, J., Krogh, A. & Palmer, R.G. (1991). Introduction to the Theory of Neural Computation. Addison-Wesley, New York.
20. Hoffmann, K. & Stone, J. (1971) Conduction velocity of afferents to cat visual cortex: A correlation with cortical receptive field properties. Brain Res., 32, 460-466.
21. Hubel, D.H. & Wiesel, T.N. (1962) Receptive fields, binoculular interaction and functional architecture in the cat's visual cortex. J. Physiol. (Lond.), 160, 106-154.
22. Hyvärinen, A. (1999) Survey on independent component analysis. Neural Computing Surveys, 2, 94-128.
23. Hyvärinen, A. & Hoyer, P. (2000) Emergence of phase and shift invariant features by decomposition of natural images into independent feature subspaces. Neural Comput., 12, 1705-1720.
24. Jähne, B. (1997) Digital Image Processing - Concepts, Algorithms and Scientific Applications, 4th Compl. Rev. Edn. Springer, Berlin.
25. Kayser, C., Einhäuser, W., Dümmer. O., König, P. & Körding, K.P. (2001) Extracting slow subspaces from natural videos leads to complex cells. In Dorffner, G., Bischoff, H. & Hornik, K. (eds), Artificial Neural Networks - ICANN 2001 Proceedings. Springer, Berlin, Heidelberg, pp. 1075-1080.
26. Kjaer, T.W., Gawne, T.J., Hertz, J.A. & Richmond, B.J. (1997) Insensitivity of V1 complex cell responses to small shifts in the retinal image of complex patterns. J. Neurophysiol., 78, 3187-3197.
27. Körding, K.P. & König, P. (2000a) A learning rule for dynamic recruitment and decorrelation. Neural Netw., 13, 1-9.
28. Körding, K.P. & König, P. (2000b) Learning with two sites of synaptic integration. Network, 11, 25-39.
29. Lampl, I., Riesenhuber, M., Poggio, T. & Ferster, D. (2001) The max operation in cells in the cat visual cortex. Soc. Neurosci. Abstr., 27, 619.30.
30. Larkum, M.E., Kaiser, K.M. & Sakmann, B. (1999a) Calcium electrogenesis in distal apical dendrites of layer 5 pyramidal cells at a critical frequency of back-propagating action potentials. Proc. Natl. Acad. Sci. USA, 96, 14600-14604.
31. Larkum, M.E., Zhu, J. & Sakmann, B. (1999b) A new cellular mechanism for coupling inputs arriving at different cortical layers. Nature, 398, 338-341.
32. Lisman, J. (1989) A mechanism for the Hebb and the anti-Hebb processes underlying learning and memory. Proc. Natl. Acad. Sci. USA, 86, 9574-9578.
33. Lisman, J. (1994) The CaM kinase II hypothesis for the storage of synaptic memory. Trends Neurosci., 17, 406-412.
34. Malpeli, J., Lee, C., Schwark, H. & Weyand, T. (1986) Cat area 17. I. Pattern of thalamic control of cortical layers. J. Neurophysiol., 56, 1062-1073.
35. Markram, H., Lübke, J., Frotscher, M. & Sakmann, B. (1997) Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science, 275, 213-215.
36. Mel, B.W. (1997) SEEMORE: combining color, shape, and texture histogramming in a neurally inspired approach to visual object recognition. Neural Comput, 9, 777-804.
37. Mel, B.W., Ruderman, D.L. & Archie, K.A. (1998) Translation-invariant orientation tuning in visual 'complex' cells could derive from intradendritic computations. J. Neurosci., 18, 4325-4334.
38. Movshon, J. (1975) The velocity tuning of single units in cat striate cortex. J. Physiol. (Lond.), 249, 445-468.
39. Ngezahayo, A., Schachner, M. & Artola, A. (2000) Synaptic activity modulates the induction of bidirectional synaptic changes in adult mouse hippocampus. J. Neurosci., 20, 2451-2458.
40. Olshausen, B.A. & Field, D.J. (1996) Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 381, 607-609.
41. Olshausen, B.A. & Field, D.J. (1997) Sparse coding with an overcomplete basis set: A strategy employed by V1? Vision Res., 37, 3311-3325.
42. Pike, F.G., Meredith, R.M., Olding, A.W.A. & Paulsen, O. (1999) Postsynaptic bursting is essential for 'Hebbian' induction of associative long-term potentiation at excitatory synapses in rat hippocampus. J. Physiol. (Lond.), 518, 571-576.
43. Reid, R.C. & Alonso, J.M. (1996) The processing and encoding of information in the visual cortex. Curr. Opin. Neurobiol., 6, 475-480.
44. Riesenhuber, M. & Poggio, T. (1999) Hierarchical models of object recognition in cortex. Nature Neurosci., 2, 1019-1025.
45. Rolls, E.T. & Tovee, M.J. (1995) Sparseness of the neuronal representation of stimuli in the primate temporal visual cortex. J. Neurophysiol., 73, 713-726.
46. Schraudolph, N.N. & Sejnowski, T.J. (1992) Competitive anti-Hebbian learning of invariants. In Moody, J.E., Hanson, S.J. & Lippmann, R.P. (eds), Advances in Neural Information Processing Systems, Vol. 4. Morgan Kaufmann, San Mateo, pp. 1017-1024.
47. Schwartz, O. & Simoncelli, E.P. (2001) Natural signal statistics and sensory gain control. Nature Neurosci., 4, 819-825.
48. Siegel, M., Sarnthein, J. & König, P. (1999) Laminar distribution of synchronization and orientation tuning in area 18 of awake behaving cats. Soc. Neurosci. Abstr., 25, 678.
49. Skottun, B.C., De Valois, R.L., Grosof, G.H., Movshon, J.A., Albrecht, D.G. & Bonds, A.B. (1991) Classifying simple and complex cells on the basis of response modulation. Vision Res., 31, 1079-1086.
50. Sompolinsky, H. & Shapley, R. (1997) New perspectives on the mechanisms for orientation selectivity. Curr. Opin. Neurobiol., 7, 514-522.
51. Toyama, K., Kimura, M. & Tanaka, K. (1981) Organization of cat visual cortex as investigated by cross-correlation technique. J. Neurophysiol., 46, 202-214.
52. Vinje, W.E. & Gallant, J.L. (2000) Sparse coding and decorrealtion in primary visual cortex during natural vision. Science, 287, 1273-1276.
53. Wallis, G. & Rolls, E.T. (1997) Invariant face and object recognition in the visual systems. Prog. Neurobiol., 51, 167-194.
54. Wilson, J. & Sherman, S. (1976) Receptive-field characteristics of neurons in cat striate cortex: Changes with visual field eccentricity. J. Neurophysiol., 39, 512-533.
55. Wiskott, L. & Sejnowski, T. (2001) Slow feature analysis: Unsupervised learning of invariances. Neural Comp., in press.
56. Yang, X.D. & Faber, D.S. (1991) Initial synaptic efficacy influences induction and expression of long-term changes in transmission. Proc. Natl. Acad. Sci. USA, 88, 4299-4303.