Simple-cell-like receptive fields maximize temporal coherence in natural video

Neural Computation

Volumn 15, Issue 3, 2003, Pages 663-691

  Hurri, Jarmo ^a   Hyvärinen, Aapo ^a  

^a AALTO UNIVERSITY   (Finland)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL; ARTICLE; BIOLOGICAL MODEL; HUMAN; NERVE CELL; NONLINEAR SYSTEM; PHYSIOLOGY; REACTION TIME; VISUAL CORTEX;

ANIMALS; HUMANS; MODELS, NEUROLOGICAL; NEURONS; NONLINEAR DYNAMICS; REACTION TIME; VISUAL CORTEX;

EID: 0037365920     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/089976603321192121     Document Type: Article

References (28)

1. Becker, S. (1993). Learning to categorize objects using temporal coherence. In S. J. Hanson, J. D. Cowan, & C. L. Giles (Eds.), Advances in neural information processing systems, 5 (pp. 361-368). San Mateo, CA: Morgan Kaufmann.
2. Becker, S., & Hinton, G. (1992). Self-organizing neural network that discovers surfaces in random-dot stereograms. Nature, 355(6356), 161-163.
3. Bell, A., & Sejnowski, T. J. (1997). The independent components of natural scenes are edge filters. Vision Research, 37(23), 3327-3338.
4. Carandini, M., Heeger, D. J., & Movshon, J. A. (1997). Linearity and normalization in simple cells of the macaque primary visual cortex. Journal of Neuroscience, 17(21), 8621-8644.
5. DeAngelis, G. C., Ohzawa, I., & Freeman, R. D. (1993a). Spatiotemporal organization of simple-cell receptive fields in the cat's striate cortex. I. General characteristics and postnatal development. Journal of Neurophysiology, 69(4), 1091-1117.
6. DeAngelis, G. C., Ohzawa, I., & Freeman, R. D. (1993b). Spatiotemporal organization of simple-cell receptive fields in the cat's striate cortex. II. Linearity of temporal and spatial summation. Journal of Neurophysiology, 69(4), 1118-1135.
7. Dong, D. W. & Atick, J. (1995). Temporal decorrelation: A theory of lagged and nonlagged responses in the lateral geniculate nucleus. Network: Computation in Neural Systems, 6(2), 159-178.
8. Fan, K., & Hoffman, A. J. (1955). Some metric inequalities in the space of matrices. Proceedings of the American Mathematical Society, 6, 111-116.
9. Field, D. (1994). What is the goal of sensory coding? Neural Computation, 6(4), 559-601.
10. Földiák, P. (1991). Learning invariance from transformation sequences. Neural Computation, 3(2), 194-200.
11. Heeger, D. J. (1992). Normalization of cell responses in cat striate cortex. Visual Neuroscience, 9, 181-198.
12. Hoyer, P. O., & Hyvärinen, A. (2002). A multi-layer sparse coding network learns contour coding from natural images. Vision Research, 42(12), 1593-1605.
13. Hurri, J. (1997). Independent component analysis of image data. Master's thesis, Helsinki University of Technology. Available on-line: http://www. cis.hut.fi/jarmo/publications/.
14. Hyvärinen, A., & Hoyer, P. O. (2001). A two-layer sparse coding model learns simple and complex cell receptive fields and topography from natural images. Vision Research, 41(18), 2413-2423.
15. Hyvärinen, A., Karhunen, J., & Oja, E. (2001). Independent component analysis. New York: Wiley.
16. Kayser, C., Einhäuser, W., Dümmer, O., König, P., & Körding, K. (2001). Extracting slow subspaces from natural videos leads to complex cells. In G. Dorffner, H. Bischof, & K. Hornik (Eds.), Artificial neural networks-ICANN 2001 (pp. 1075-1080). New York: Springer-Verlag.
17. Kohonen, T., Kaski, S., & Lappalainen, H. (1997). Self-organized formation of various invariant-feature filters in the adaptive-subspace SOM. Neural Computation, 9(6), 1321-1344.
18. Luenberger, D. G. (1969). Optimization by vector space methods. New York: Wiley.
19. Mitchison, G. (1991). Removing time variation with the anti-Hebbian differential synapse. Neural Computation, 3(3), 312-320.
20. Olshausen, B. A., & Field, D. (1996). Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 381(6583), 607-609.
21. Olshausen, B. A., & Field, D. (1997). Sparse coding with an overcomplete basis set: A strategy employed by V1? Vision Research, 37, 3311-3325.
22. Oppenheim, A., & Schafer, R. (1975). Digital signal processing. Upper Saddle River, NJ: Prentice Hall.
23. Palmer, S. E. (1999). Vision science - Photons to phenomenology. Cambridge, MA: MIT Press.
24. Simoncelli, E. P., & Olshausen, B. A. (2001). Natural image statistics and neural representation. Annual Review of Neuroscience, 24, 1193-1216.
25. Stone, J. (1996). Learning visual parameters using spatiotemporal smoothness constraints. Neural Computation, 8(7), 1463-1492.
26. van Hateren, J. H., & Ruderman, D. L. (1998). Independent component analysis of natural image sequences yields spatio-temporal filters similar to simple cells in primary visual cortex. Proceedings of the Royal Society of London B, 265(1412), 2315-2320.
27. van Hateren, J. H., & van der Schaaf, A. (1998). Independent component filters of natural images compared with simple cells in primary visual cortex. Proceedings of the Royal Society of London B, 265(1394), 359-366.
28. Wiskott, L., & Sejnowski, T. J. (2002). Slow feature analysis: Unsupervised learning of invariances. Neural Computation, 14(4), 715-770.