Statistical models of natural images and cortical visual representation

Topics in Cognitive Science

Volumn 2, Issue 2, 2010, Pages 251-264

  Hyvärinen, Aapo ^a  

^a UNIVERSITY OF HELSINKI   (Finland)

Author keywords

Computational models; Natural image statistics; Natural scenes; Probabilistic models; Vision

Indexed keywords

BIOLOGICAL MODEL; HUMAN; LEARNING; NERVE CELL; PHOTOSTIMULATION; PHYSIOLOGY; STATISTICAL MODEL; VISION; VISUAL CORTEX;

HUMANS; LEARNING; MODELS, NEUROLOGICAL; MODELS, STATISTICAL; NEURONS; PHOTIC STIMULATION; VISUAL CORTEX; VISUAL PERCEPTION;

EID: 79957657604     PISSN: 17568757     EISSN: 17568765     Source Type: Journal    
DOI: 10.1111/j.1756-8765.2009.01057.x     Document Type: Article

References (42)

1. Barlow, H. B. (1961). Possible principles underlying the transformations of sensory messages. In W. A. Rosenblith (Ed.), Sensory communication (pp. 217-234). Cambridge, MA: MIT Press.
2. Bell, A. J., & Sejnowski, T. J. (1997). The "independent components" of natural scenes are edge filters. Vision Research, 37, 3327-3338.
3. Blasdel, G. G. (1992). Orientation selectivity, preference, and continuity in monkey striate cortex. Journal of Neuroscience, 12(8), 3139-3161.
4. Buiatti, M., & Van Vreeswijk, C. (2003). Variance normalisation: A key mechanism for temporal adaptation in natural vision? Vision Research, 43, 1895-1906.
5. Comon, P. (1994). Independent component analysis-a new concept? Signal Processing, 36, 287-314.
6. DeAngelis, G. C., Ghose, G. M., Ohzawa, I., & Freeman, R. D. (1999). Functional micro-organization of primary visual cortex: Receptive field analysis of nearby neurons. Journal of Neuroscience, 19(10), 4046-4064.
7. Field, D. J. (1994). What is the goal of sensory coding? Neural Computation, 6, 559-601.
8. Földiák, P. (1991). Learning invariance from transformation sequences. Neural Computation, 3, 194-200.
9. Geisler, W. S. (2008). Visual perception and the statistical properties of natural scenes. Annual Review of Psychology, 59, 167-192.
10. Geisler, W. S., Perry, J. S., Super, B. J., & Gallogly, D. P. (2001). Edge co-occurrence in natural images predicts contour grouping performance. Vision Research, 41, 711-724.
11. Hashimoto, W. (2003). Quadratic forms in natural images. Network: Computation in Neural Systems, 14(4), 765-788.
12. Van Hateren, J. H., & Ruderman, D. L. (1998). Independent component analysis of natural image sequences yields spatiotemporal filters similar to simple cells in primary visual cortex. Proceedings of the Royal Society Series B, 265, 2315-2320.
13. Van Hateren, J. H., & Van Der Schaaf, A. (1998). Independent component filters of natural images compared with simple cells in primary visual cortex. Proceedings of the Royal Society Series B, 265, 359-366.
14. Heeger, D. (1992). Normalization of cell responses in cat striate cortex. Visual Neuroscience, 9, 181-198.
15. Hurri, J., & Hyvärinen, A. (2003). Simple-cell-like receptive fields maximize temporal coherence in natural video. Neural Computation, 15(3), 663-691.
16. Hyvärinen, A. (1999a). Fast and robust fixed-point algorithms for independent component analysis. IEEE Transactions on Neural Networks, 10(3), 626-634.
17. Hyvärinen, A. (1999b). Sparse code shrinkage: Denoising of non-Gaussian data by maximum likelihood estimation. Neural Computation, 11(7), 1739-1768.
18. Hyvärinen, A., Gutmann, M., & Hoyer, P. O. (2005). Statistical model of natural stimuli predicts edge-like pooling of spatial frequency channels in V2. BMC Neuroscience, 6(12).
19. Hyvärinen, A., & Hoyer, P. O. (2000). Emergence of phase and shift invariant features by decomposition of natural images into independent feature subspaces. Neural Computation, 12(7), 1705-1720.
20. Hyvärinen, A., & Hoyer, P. O. (2001). A two-layer sparse coding model learns simple and complex cell receptive fields and topography from natural images. Vision Research, 41(18), 2413-2423.
21. Hyvärinen, A., Hurri, J., & Hoyer, P. O. (2009). Natural image statistics. Berlin: Springer-Verlag.
22. Hyvärinen, A., Hurri, J., & Väyrynen, J. (2003). Bubbles: A unifying framework for low-level statistical properties of natural image sequences. Journal of the Optical Society of America A, 20(7), 1237-1252.
23. Hyvärinen, A., Karhunen, J., & Oja, E. (2001). Independent component analysis. London: Wiley Interscience.
24. Karklin, Y., & Lewicki, M. S. (2008). Emergence of complex cell properties by learning to generalize in natural scenes. Nature, 104, 19120-19125.
25. Kohonen, T. (2001). Self-organizing maps (3rd ed.). Berlin: Springer.
26. Köster, U., & Hyvärinen, A. (2007). A two-layer ICA-like model estimated by score matching. In J. P. Marques de Sa, W. Duch & L. A. Alexandre (Eds.), Proceedings of the international conference on artificial neural networks (ICANN2007) (pp. 798-807). Porto, Portugal. Berlin: Springer-Verlag.
27. Köster, U., Lindgren, J. T., Gutmann, M., & Hyvärinen, A. (2009). Learning natural image structure with a horizontal product model. In T. Adali, C. Jutten, J. M. Travassos Romano, & A. Kardec Barros (Eds.), Proceedings of the international conference on independent component analysis and blind signal separation (ICA2009) (pp. 507-514). Paraty, Brazil, Berlin: Springer-Verlag.
28. Köster, U., Lindgren, J. T., & Hyvärinen, A. (2009). Estimating Markov random field potentials for natural images. In T. Adali, C. Jutten, J. M. Travassos Romano & A. Kardec Barros (Eds.), Proceedings of the international conference on independent component analysis and blind signal separation (ICA2009) (pp. 515-522), Paraty, Brazil, Berlin: Springer-Verlag.
29. Krüger, N. (1998). Collinearity and parallelism are statistically significant second order relations of complex cell responses. Neural Processing Letters, 8, 117-129.
30. Olshausen, B. A. (2003). Principles of image representation in visual cortex. In L. M. Chalupa & J. S. Werner (Eds.), The visual neurosciences. Cambridge, MA: MIT Press.
31. Olshausen, B. A., & Field, D. J. (1996). Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 381, 607-609.
32. Olshausen, B. A., & Field, D. J. (1997). Sparse coding with an overcomplete basis set: A strategy employed by V1? Vision Research, 37, 3311-3325.
33. Osindero, S., Welling, M., & Hinton, G. E. (2006). Topographic product models applied to natural scene statistics. Neural Computation, 18(2), 381-414.
34. Pollen, D., & Ronner, S. (1983). Visual cortical neurons as localized spatial frequency filters. IEEE Transactions on Systems, Man, and Cybernetics, 13, 907-916.
35. Schwartz, O., & Simoncelli, E. P. (2001). Natural signal statistics and sensory gain control. Nature Neuroscience, 4(8), 819-825.
36. Sigman, M., Cecchi, G. A., Gilbert, C. D., & Magnasco, M. O. (2001). On a common circle: Natural scenes and gestalt rules. Proceedings of the National Academy of Science, USA, 98, 1935-1940.
37. Simoncelli, E. P. (2005). Statistical modeling of photographic images. In A. Bovik (Ed.), Handbook of image and video processing (2nd ed.). London: Academic Press.
38. Simoncelli, E. P., & Olshausen, B. A. (2001). Natural image statistics and neural representation. Annual Review of Neuroscience, 24, 1193-1216.
39. Srivastava, A., Lee, A. B., Simoncelli, E. P., & Chu, S.-C. (2003). On advances in statistical modelling of natural images. Journal of Mathematical Imaging and Vision, 18, 17-33.
40. Swindale, N. V. (1996). The development of topography in the visual cortex: A review of models. Network, 7(2), 161-247.
41. Wainwright, M. J., Schwartz, O., & Simoncelli, E. P. (2002). Natural image statistics and divisive normalization: Modeling nonlinearity and adaptation in cortical neurons. In R. P. N. Rao, B. A. Olshausen & M. S. Lewicki, (Eds.), Probabilistic models of the brain (pp. 203-222). Cambridge, MA: MIT Press.
42. Wiskott, L., & Sejnowski, T. J. (2002). Slow feature analysis: Unsupervised learning of invariances. Neural Computation, 14(4), 715-770.