Divisive normalization: Justification and effectiveness as efficient coding transform

Advances in Neural Information Processing Systems 23: 24th Annual Conference on Neural Information Processing Systems 2010, NIPS 2010

Volumn , Issue , 2010, Pages

  Lyu, Siwei ^a  

^a State University of New York   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CODES (SYMBOLS); SENSORY ANALYSIS; STATISTICS;

ANALYSIS EVALUATION; MULTIVARIATE T; NORMALISATION; PERFORMANCE; QUANTITATIVE EVALUATION; SENSORY SIGNALS; STATISTICAL DEPENDENCIES; STATISTICAL PROPERTIES; T-MODEL;

MATHEMATICAL TRANSFORMATIONS;

EID: 85162063480     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (35)

1. D. F. Andrews and C. L. Mallows. Scale mixtures of normal distributions. Journal of the Royal Statistical Society. Series B (Methodological), 36(1):99-102, 1974.
2. F Attneave. Some informational aspects of visual perception. Psych. Rev., 61:183-193, 1954.
3. H B Barlow. Possible principles underlying the transformation of sensory messages. In W A Rosenblith, editor, Sensory Communication, pages 217-234. MIT Press, Cambridge, MA, 1961.
4. A J Bell and T J Sejnowski. The 'independent components' of natural scenes are edge filters. 37(23):3327-3338, 1997.
5. Matthias Bethge. Factorial coding of natural images: how effective are linear models in removing higherorder dependencies? J. Opt. Soc. Am. A, 23(6):1253-1268, 2006.
6. R. W. Buccigrossi and E. P. Simoncelli. Image compression via joint statistical characterization in the wavelet domain. 8(12):1688-1701, 1999.
7. P.J. Burt and E.H. Adelson. The Laplacian pyramid as a compact image code. IEEE Transactions on Communication, 31(4):532-540, 1981.
8. J. Costa, A. Hero, and C. Vignat. On solutions to multivariate maximum α-entropy problems. In EMMCVPR, 2003.
9. T. Cover and J. Thomas. Elements of Information Theory. Wiley-Interscience, 2nd edition, 2006.
10. D J Field. Relations between the statistics of natural images and the response properties of cortical cells. 4(12):2379-2394, 1987.
11. J. Foley. Human luminence pattern mechanisims: Masking experimants require a new model. J. of Opt. Soc. of Amer. A, 11(6):1710-1719, 1994.
12. D. J. Heeger. Normalization of cell responses in cat striate cortex. Visual neural science, 9:181-198, 1992.
13. P. Johannesma. The pre-response stimulus ensemble of neurons in the cochlear nucleus. In Symposium on Hearing Theory, pages 58-69, Eindhoven, Holland, 1972.
14. Samuel Kotz and Saralees Nadarajah. Multivariate t Distributions and Their Applications. Cambridge University Press, 2004.
15. M S Lewicki. Efficient coding of natural sounds. Nature Neuroscience, 5(4):356-363, 2002.
16. S. Lyu and E. P. Simoncelli. Nonlinear image representation using divisive normalization. In IEEE Conference on Computer Vision and Patten Recognition (CVPR), Anchorage, AK, June 2008.
17. S Lyu and E P Simoncelli. Nonlinear extraction of 'independent components' of natural images using radial Gaussianization. Neural Computation, 18(6):1-35, 2009.
18. J. Malo, I. Epifanio, R. Navarro, and E. P. Simoncelli. Non-linear image representation for efficient perceptual coding. 15(1):68-80, January 2006.
19. V. Mante, V. Bonin, and M. Carandini. Functional mechanisms shaping lateral geniculate responses to artificial and natural stimuli. Neuron, 58:625-638, May 2008.
20. B A Olshausen and D J Field. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 381:607-609, 1996.
21. Liam Paninski. Estimation of entropy and mutual information. Neural Comput., 15(6):1191-1253, 2003.
22. S. Roth and M. Black. Fields of experts: A framework for learning image priors. volume 2, pages 860-867, 2005.
23. O. Schwartz and E. P. Simoncelli. Natural signal statistics and sensory gain control. Nature Neuroscience, 4(8):819-825, August 2001.
24. R Shapley and C Enroth-Cugell. Visual adaptation and retinal gain control. Progress in Retinal Research, 3:263-346, 1984.
25. E P Simoncelli and R WBuccigrossi. Embedded wavelet image compression based on a joint probability model. In Proc 4th IEEE Int'l Conf on Image Proc, volume I, pages 640-643, Santa Barbara, October 26-29 1997. IEEE Sig Proc Society.
26. Fabian H. Sinz and Matthias Bethge. The conjoint effect of divisive normalization and orientation selectivity on redundancy reduction. In NIPS. 2009.
27. M. Studeny and J. Vejnarova. The multiinformation function as a tool for measuring stochastic dependence. In M. I. Jordan, editor, Learning in Graphical Models, pages 261-297. Dordrecht: Kluwer., 1998.
28. Roberto Valerio and Rafael Navarro. Input-output statistical independence in divisive normalization models of v1 neurons. Network: Computation in Neural Systems, 14(4):733-745, 2003.
29. A van der Schaaf and J H van Hateren. Modelling the power spectra of natural images: Statistics and information. Vision Research, 28(17):2759-2770, 1996.
30. Oldrich Vasicek. A test for normality based on sample entropy. Journal of the Royal Statistical Society, Series B, 38(1):54-59, 1976.
31. M. J. Wainwright, O. Schwartz, and E. P. Simoncelli. Natural image statistics and divisive normalization: Modeling nonlinearity and adaptation in cortical neurons. In Probabilistic Models of the Brain: Perception and Neural Function, pages 203-222. MIT Press, 2002.
32. M J Wainwright and E P Simoncelli. Scale mixtures of Gaussians and the statistics of natural images. In S. A. Solla, T. K. Leen, and K.-R. Müller, editors, Adv. Neural Information Processing Systems (NIPS*99), volume 12, pages 855-861, Cambridge, MA, May 2000. MIT Press.
33. A. Watson and J. Solomon. A model of visual contrast gain control and pattern masking. J. Opt. Soc. Amer. A, pages 2379-2391, 1997.
34. B Wegmann and C Zetzsche. Statistical dependence between orientation filter outputs used in an human vision based image code. In Proc Visual Comm. and Image Processing, volume 1360, pages 909-922, Lausanne, Switzerland, 1990.
35. M.Welling, G. E. Hinton, and S. Osindero. Learning sparse topographic representations with products of Student-t distributions. pages 1359-1366, 2002.