Efficient coding of natural images with a population of noisy Linear-Nonlinear neurons

Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011

Volumn , Issue , 2011, Pages

  Karklin, Yan ^a   Simoncelli, Eero P ^a  

^a NEW YORK UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CODES (SYMBOLS); IMAGE CODING; NEURONS; NUMERICAL METHODS; POPULATION STATISTICS;

CODING MODELS; INPUT AND OUTPUTS; METABOLIC COST; NATURAL IMAGES; NON-LINEAR NEURONS; NON-LINEAR RESPONSE; ORIENTED FILTER; PRIMARY VISUAL CORTEX; RESPONSE FUNCTIONS; SENSORY CODING;

INDEPENDENT COMPONENT ANALYSIS;

EID: 85162509235     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (35)

1. F. Attneave, "Some informational aspects of visual perception.," Psychological Review, vol. 61, no. 3, pp. 183-193, 1954.
2. H. Barlow, "Possible principles underlying the transformations of sensory messages," in Sensory Communication, pp. 217-234, MIT Press, 1961.
3. M. V. Srinivasan, S. B. Laughlin, and A. Dubs, "Predictive coding: A fresh view of inhibition in the retina," Proceedings of the Royal Society of London. Series B. Biological Sciences, vol. 216, pp. 427-459, Nov. 1982.
4. J. J. Atick and A. N. Redlich, "Towards a theory of early visual processing," Neural Computation, vol. 2, no. 3, pp. 308-320, 1990.
5. J. J. Atick, "Could information theory provide an ecological theory of sensory processing?," Network Computation in Neural Systems, vol. 3, no. 2, pp. 213-251, 1992.
6. E. Doi and M. S. Lewicki, "A theory of retinal population coding," in Advances in Neural Information Processing Systems 19 (B. Schölkopf, J. Platt, and T. Hoffman, eds.), pp. 353-360, Cambridge, MA: MIT Press, 2007.
7. J. Nadal and N. Parga, "Nonlinear neurons in the low-noise limit: a factorial code maximizes information transfer," Network: Computation in Neural Systems, vol. 5, no. 4, pp. 565-581, 1994.
8. A. J. Bell and T. J. Sejnowski, "An Information-Maximization approach to blind separation and blind deconvolution," Neural Computation, vol. 7, no. 6, pp. 1129-1159, 1995.
9. B. A. Olshausen and D. J. Field, "Emergence of simple-cell receptive field properties by learning a sparse code for natural images," Nature, vol. 381, no. 6583, pp. 607-609, 1996.
10. A. J. Bell and T. J. Sejnowski, "The "independent components" of natural scenes are edge filters," Vision Research, vol. 37, no. 23, pp. 3327-3338, 1997.
11. S. Laughlin, "A simple coding procedure enhances a neuron's information capacity," Z Naturforsch, no. Sep-Oct, 1981.
12. A. Treves, S. Panzeri, E. T. Rolls, M. Booth, and E. A. Wakeman, "Firing rate distributions and efficiency of information transmission of inferior temporal cortex neurons to natural visual stimuli," Neural Computation, vol. 11, no. 3, p. 601-631, 1999.
13. N. Brenner, W. Bialek, and R. de Ruyter van Steveninck, "Adaptive rescaling maximizes information transmission," Neuron, vol. 26, no. 3, pp. 695-702, 2000. PMID: 10896164.
14. A. L. Fairhall, G. D. Lewen, W. Bialek, and R. R. de Ruyter van Steveninck, "Efficiency and ambiguity in an adaptive neural code," Nature, vol. 412, no. 6849, p. 787-792, 2001.
15. M. D. McDonnell and N. G. Stocks, "Maximally informative stimuli and tuning curves for sigmoidal Rate-Coding neurons and populations," Physical Review Letters, vol. 101, no. 5, p. 058103, 2008.
16. W. B. Levy and R. A. Baxter, "Energy efficient neural codes," Neural Computation, vol. 8, no. 3, pp. 531-543, 1996.
17. R. Baddeley, L. F. Abbott, M. C. Booth, F. Sengpiel, T. Freeman, E. A. Wakeman, and E. T. Rolls, "Responses of neurons in primary and inferior temporal visual cortices to natural scenes.," Proceedings of the Royal Society B: Biological Sciences, vol. 264, no. 1389, pp. 1775-1783, 1997.
18. V. Balasubramanian and M. J. Berry, "A test of metabolically efficient coding in the retina," Network: Computation in Neural Systems, vol. 13, no. 4, p. 531-552, 2002.
19. L. Franco, E. T. Rolls, N. C. Aggelopoulos, and J. M. Jerez, "Neuronal selectivity, population sparseness, and ergodicity in the inferior temporal visual cortex," Biol. Cybernetics, vol. 96, no. 6, pp. 547-560, 2007.
20. S. B. Laughlin, R. R. V. Steveninck, and J. C. Anderson, "The metabolic cost of neural information," Nat. Neurosci, vol. 1, no. 1, p. 36-41, 1998.
21. P. Lennie, "The cost of cortical computation," Current Biology, vol. 13, pp. 493-497, Mar. 2003.
22. D. Attwell and S. B. Laughlin, "An energy budget for signaling in the grey matter of the brain," Journal of Cerebral Blood Flow and Metabolism, vol. 21, no. 10, pp. 1133-1145, 2001.
23. D. K. Warland, P. Reinagel, and M. Meister, "Decoding visual information from a population of retinal ganglion cells," Journal of Neurophysiology, vol. 78, no. 5, pp. 2336 -2350, 1997.
24. J.W. Pillow, L. Paninski, V. J. Uzzell, E. P. Simoncelli, and E. J. Chichilnisky, "Prediction and decoding of retinal ganglion cell responses with a probabilistic spiking model," The Journal of Neuroscience, vol. 25, no. 47, pp. 11003 -11013, 2005.
25. D. J. Heeger, "Half-Squaring in responses of cat striate cells," Visual Neuroscience, vol. 9, no. 05, pp. 427-443, 1992.
26. W. Bialek, R. van Steveninck, and N. Tishby, "Efficient representation as a design principle for neural coding and computation," in IEEE International Symposium on Information Theory, pp. 659-663, 2006.
27. T. von der Twer and D. I. A. MacLeod, "Optimal nonlinear codes for the perception of natural colours," Network: Computation in Neural Systems, vol. 12, no. 3, pp. 395-407, 2001.
28. A. M. Walczak, G. Tkačik, and W. Bialek, "Optimizing information flow in small genetic networks. II. feed-forward interactions," Physical Review E, vol. 81, no. 4, p. 041905, 2010.
29. E. Doi, T. Inui, T.-W. Lee, T. Wachtler, and T. J. Sejnowski, "Spatiochromatic receptive field properties derived from information-theoretic analyses of cone mosaic responses to natural scenes," Neural Computation, vol. 15, pp. 397-417, 2003.
30. H. Wässle, U. Grünert, J. Röhrenbeck, and B. B. Boycott, "Retinal ganglion cell density and cortical magnification factor in the primate," Vision Research, vol. 30, no. 11, pp. 1897-1911, 1990.
31. E. J. Chichilnisky and R. S. Kalmar, "Functional asymmetries in ON and OFF ganglion cells of primate retina," The Journal of Neuroscience, vol. 22, no. 7, pp. 2737 -2747, 2002.
32. M. Carandini, "Amplification of Trial-to-Trial response variability by neurons in visual cortex," PLoS Biol, vol. 2, no. 9, p. e264, 2004.
33. C. L. Passaglia and J. B. Troy, "Information transmission rates of cat retinal ganglion cells," Journal of Neurophysiology, vol. 91, no. 3, pp. 1217 -1229, 2004.
34. E. Doi, J. L. Gauthier, G. D. Field, J. Shlens, A. Sher, M. Greschner, T. Machado, K. Mathieson, D. Gunning, A. M. Litke, L. Paninski, E. J. Chichilnisky, and E. P. Simoncelli, "Redundant representations in macaque retinal populations are consistent with efficient coding," in Computational and Systems Neuroscience (CoSyNe), February 2011.
35. B. T. Vincent and R. J. Baddeley, "Synaptic energy efficiency in retinal processing," Vision Research, vol. 43, no. 11, pp. 1285-1292, 2003.