Learning nonlinear statistical regularities in natural images by modeling the outer product of image intensities

Neural Computation

Volumn 26, Issue 4, 2014, Pages 693-711

  Qi, Peng ^a   Hu, Xiaolin ^a  

^a TSINGHUA UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; BIOLOGICAL MODEL; COMPUTER SIMULATION; CYTOLOGY; HUMAN; LEARNING; LETTER; NERVE CELL; NERVE CELL NETWORK; NONLINEAR SYSTEM; NORMAL DISTRIBUTION; PHYSIOLOGY; VISUAL CORTEX; VISUAL SYSTEM;

ALGORITHMS; COMPUTER SIMULATION; HUMANS; LEARNING; MODELS, NEUROLOGICAL; NERVE NET; NEURONS; NONLINEAR DYNAMICS; NORMAL DISTRIBUTION; VISUAL CORTEX; VISUAL PATHWAYS;

EID: 84896879858     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/NECO_a_00567     Document Type: Letter

References (20)

1. Bonds, A. B. (1989). Role of inhibition in the specification of orientation selectivity of cells in the cat striate cortex. Visual Neuroscience, 2, 41-55
2. Cai, D., He, X., & Han, J. (2008). SRDA: An efficient algorithm for large-scale discriminant analysis. IEEE Transactions on Knowledge and Data Engineering, 20, 1-12
3. Coates, A., Lee, H., & Ng, A. Y. (2011). An analysis of single-layer networks in unsupervised feature learning. In Proceedings of the 14th International Conference on Artificial Intelligence and Statistics (AISTATS)
4. De Valois, R. L., Albrecht, D. G., & Thorell, L. G. (1982). Spatial frequency selectivity of cells in macaque visual cortex. Vision Research, 22(5), 545-559
5. Doi, E., Inui, T., Lee, T.-W., Wachtler, T., & Sejnowski, T. J. (2003). Spatiochromatic receptive field properties derived from information-theoretic analyses of cone mosaic responses to natural scenes. Neural Computation, 15(2), 397-417
6. Hyvärinen, A., & Hoyer, P. (2000). Emergence of phase- and shift-invariant features by decomposition of natural images into independent feature subspaces. Neural Computation, 12(7), 1705-1720
7. Hyvärinen, A., Hoyer, P. O., & Inki, M. O. (2001). Topographic independent component analysis. Neural Computation, 13, 1527-1558
8. Hyvärinen, A., Hurri, J., & Hoyer, P. O. (2009). Natural image statistics. New York: Springer-Verlag
9. Jones, H. E., Wang, W., & Sillito, A. M. (2002). Spatial organization and magnitude of orientation contrast interactions in primate V1. Journal of Neurophysiology, 88(5), 2796-2808
10. Karklin, Y., & Lewicki, M. S. (2005). A hierarchical Bayesian model for learning nonlinear statistical regularities in non-stationary natural signals. Neural Computation, 17(2), 397-423
11. Karklin, Y.,&Lewicki, M. S. (2009). Emergence of complex cell properties by learning to generalize in natural scenes. Nature, 457, 83-86
12. Köster, U., & Hyvärinen, A. (2010). A two-layer model of natural stimuli estimated with score matching. Neural Computation, 22(9), 2308-2333
13. Lee, H., Battle, A., Raina, R.,&Ng, A. Y. (2007). Efficient sparse coding algorithms. In B. Schölkopf, J. Platt,&T. Hoffman (Eds.), Advances in neural information processing systems, 19 (pp. 801-808). Cambridge, MA: MIT Press
14. Lee, H., Ekanadham, C., & Ng, A. (2008). Sparse deep belief net model for visual area V2. In J. Platt, D. Koller, Y. Singer, & S. Roweis (Eds.), Advances in neural information processing systems, 20 (pp. 873-880). Cambridge, MA: MIT Press
15. Movshon, J. A., Thompson, I. D., & Tolhurst, D. J. (1978). Spatial summation in the receptive fields of simple cells in the cats striate cortex. Journal of Physiology, 283, 53-77
16. Olshausen, B. A., & Field, D. J. (1996). Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 381(6583), 607-609
17. Ranzato, M., & Hinton, G. E. (2010). Modeling pixel means and covariances using factorized third-order Boltzmann machines. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 2551-2558). Piscataway, NJ: IEEE
18. Schwartz, O., Sejnowski, T. J., & Dayan, P. (2006). Soft mixer assignment in a hierarchical generative model of natural scene statistics. Neural Computation, 18, 2680-2718
19. Schwartz, O., & Simoncelli, E. (2001). Natural signal statistics and sensory gain control. Nature Neuroscience, 4(8), 819-825
20. van Hateren, J. H., & van der Schaaf, A. (1998). Independent component filters of natural images compared with simple cells in primary visual cortex. Proceedings of the Royal Society: Biological Sciences, 265(1394), 359-366