Is slowness a learning principle of the visual cortex?

Zoology

Volumn 106, Issue 4, 2003, Pages 373-382

  Wiskott, Laurenz ^a   Berkes, Pietro ^a  

^a HUMBOLDT UNIVERSITY   (Germany)

Author keywords

Complex cells; Invariances; Receptive fields; Slow feature analysis; Visual system

Indexed keywords

EID: 0347660910     PISSN: 09442006     EISSN: None     Source Type: Journal    
DOI: 10.1078/0944-2006-00132     Document Type: Conference Paper

References (29)

1. Becker, S. and G.E. Hinton. 1995. Spatial coherence as an internal teacher for a neural network. In: Backpropagation: Theory, Architecture and Applications (Y. Chauvin and D.E. Rumelhart, eds.). Lawrence Erlbaum Associates, Hillsdale, NJ, pp. 313-349.
2. Bell, A.J. and T.J. Sejnowski. 1997. The 'independent components' of natural scenes are edge filters. Vision Research 37: 3327-3338.
3. Berkes, P. and L. Wiskott. 2002. Applying slow feature analysis to image sequences yields a rich repertoire of complex cell properties. In: Proc. Intl. Conf. on Artificial Neural Networks -ICANN'02, Lecture Notes in Computer Science (J.R. Dorronsoro, ed.). Springer, Berlin, Heidelberg, pp. 81-86.
4. Berkes, P. and L. Wiskott. 2003. Slow feature analysis yields a rich repertoire of complex-cell properties. Cognitive Sciences EPrint Archive (CogPrints) 2804, http://cogprints.ecs.soton. ac.uk/archive/00002804/.
5. De Valois, R.L., E.W. Yund and N. Hepler. 1982. The orientation and direction selectivity of cells in macaque visual cortex. Vision Research 22: 531-544.
6. DeAngelis, G.C., R.D. Freeman and I. Ohzawa. 1994. Length and width tuning of neurons in the cat's primary visual cortex. Journal of Neurophysiology 71: 347-374.
7. Dobbins, A., S.W. Zucker and M.S. Cynader. 1987. Endstopped neurons in the visual cortex as a substrate for calculating curvature. Nature 329: 438-441.
8. Földiák, P. 1991. Learning invariance from transformation sequences. Neural Computation 3: 194-200.
9. Fukushima, K., S. Miyake and T. Ito. 1983. Neocognitron: a neural network model for a mechanism of visual pattern recognition. IEEE Trans, on Systems, Man, and Cybernetics 13: 826-834. Reprinted in: Neurocomputing (J.A. Anderson and E. Rosenfeld, eds.). MIT Press, Massachusetts, pp. 526-534.
10. Hubel, D.H. and T.N. Wiesel. 1962. Receptive fields, binocular interaction and functional architecture in the cat's visual cortex. J. Physiology 160: 106-154.
11. Hyvärinen, A. and P.O. Hoyer. 2000. Emergence of phase and shift invariant features by decomposition of natural images into independent features subspaces. Neural Computation 12: 1705-1720.
12. Kayser, C., W. Einhäuser, O. Dümmer, P. König and K. Körding. 2001. Extracting slow subspaces from natural videos leads to complex cells. In: Proc. Intl. Conf. on Artificial Neural Networks - ICANN '01 (G. Dorffner, H. Bischoff, H. and K. Hornik, eds.). Springer, Berlin, Heidelberg, pp. 1075-1080.
13. Konen, W., T. Maurer and C. von der Malsburg. 1994. A fast dynamic link matching algorithm for invariant pattern recognition. Neural Networks 7: 1019-1030.
14. LeCun, Y., B. Boser, J.S. Denker, D. Henderson, R.E. Howard, W. Hubbard and L.D. Jackel. 1989. Backpropagation applied to handwritten zip code recognition. Neural Computation 1: 541-551.
15. Mitchison, G. 1991. Removing time variation with the anti-Hebbian differential synapse. Neural Computation 3: 312-320.
16. Olshausen, B.A., C.H. Anderson and D.C. Van Essen. 1993. A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of information. J. of Neuroscience 13: 4700-4719.
17. Olshausen, B.A. and D.J. Field. 1996. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 381: 607-609.
18. Schiller, P.H., B.L. Finlay and S.F. Volman. 1976. Quantitative studies of single-cell properties in monkey striate cortex. I. spatiotemporal organization of receptive fields. Journal of Neurophysiology 39: 1288-1319.
19. Shevelev, I.A. 1998. Second-order features extraction in the cat visual cortex: selective and invariant sensitivity of neurons to the shape and orientation of crosses and corners. BioSystems 48: 195-204.
20. Sillito, A.M. 1975. The contribution of inhibitory mechanisms to the receptive field properties of neurons in the striate cortex of the cat. J. Physiology 250: 305-329.
21. Stone, J.V. 1996. Learning perceptually salient visual parameters using spatiotemporal smoothness constraints. Neural Computation 8: 1463-1492.
22. Swindale, N.V. 1996. The development of topography in the visual cortex: a review of models. Network: Computation in Neural Systems 7: 161-247.
23. Van Rullen, R. and S.J. Thorpe. 2001. Is it a bird? Is it a plane? Ultra-rapid visual categorisation of natural and artifactual objects. Perception 30: 655-668.
24. Versavel, M., G.A. Orban and L. Lagae. 1990. Responses of visual cortical neurons to curved stimuli and chevrons. Vision Research 30: 235-248.
25. Wallis, G. and E. Rolls. 1997. Invariant face and object recognition in the visual system. Progress in Neurobiology 51: 167-194.
26. Wiskott, L. 2003. Slow feature analysis: a theoretical analysis of optimal free responses. Neural Computation 15: 2147-2177.
27. Wiskott, L. and T. Sejnowski. 2002. Slow feature analysis: unsupervised learning of invariances. Neural Computation 14: 715-770.
28. Wiskott, L. and C. von der Malsburg. 1996. Face recognition by dynamic link matching. In: Lateral Interactions in the Cortex: Structure and Function, chapter 11 (J. Sirosh, R. Miikkulainen and Y. Choe, eds.). The UTCS Neural Networks Research Group, Austin, TX, http://www.cs.utexas.edu/users/nn/web-pubs/ htmlbook96/. Electronic book, ISBN 0-9647060-0-8.
29. Zhu, J. and C. von der Malsburg. 2003. Synapto-synaptic interactions speed up dynamic link matching. NeuroComputing 44: 721-728.