Efficient sensory encoding and Bayesian inference with heterogeneous neural populations

Neural Computation

Volumn 26, Issue 10, 2014, Pages 2103-2134

  Ganguli, Deep ^a   Simoncelli, Eero P ^a  

^a NEW YORK UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL; BAYES THEOREM; BIOLOGICAL MODEL; HUMAN; PERCEPTION; PHYSIOLOGY; SENSATION; SENSORY NERVE; SENSORY NERVE CELL;

AFFERENT PATHWAYS; ANIMALS; BAYES THEOREM; HUMANS; MODELS, NEUROLOGICAL; PERCEPTION; SENSATION; SENSORY RECEPTOR CELLS;

EID: 84907255039     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/NECO_a_00638     Document Type: Article

References (67)

1. Abbott, L., & Dayan, P. (1999). The effect of correlated variability on the accuracy of a population code. Neural Computation, 11(1), 91-101
2. Atick, J., & Redlich, A. (1990). Towards a theory of early visual processing. Neural Computation, 2(3), 308-320
3. Attneave, F. (1954). Some informational aspects of visual perception. Psychological Review, 61(3), 183-193
4. Barlow, H. (1961). Possible principles underlying the transformation of sensory messages. In W. A. Rosenbloth (Ed.), Sensory Communication (pp. 217-234). Cambridge, MA: MIT Press
5. Beck, J., Latham, P., & Pouget, A. (2011). Marginalization in neural circuits with divisive normalization. Journal of Neuroscience, 31(43), 15310-15319
6. Beck, J., Ma,W., Latham, P., & Pouget, A. (2007). Probabilistic population codes and the exponential family of distributions. Prog. Brain. Res., 165, 509-519
7. Bell, A., & Sejnowski, T. (1997). The “independent components“ of natural scenes are edge filters. Vision Research, 37(23), 3327-3338
8. Benucci, A., Saleem, A. B., & Carandini,M. (2013). Adaptationmaintains population homeostasis in primary visual cortex. Nature Neuroscience, 16(6), 724-729
9. Berens, P., Gerwinn, S., Ecker,A.,&Bethge,M. (2009). Neurometric function analysis of population codes. In Y. Bengio, D. Schuurmans, J. D. Lafferty, C. K. I.Williams, & A. Culotta (Eds.), Advances in neural information processing systems, 22 (pp. 90- 98). Red Hook, NY: Curran
10. Berkes, P., Orbáan, G., Lengyel, M., & Fiser, J. (2011). Spontaneous cortical activity reveals hallmarks of an optimal internal model of the environment. Science, 331(6013), 83-87
11. Bethge, M., Rotermund, D., & Pawelzik, K. (2002). Optimal short-term population coding: When Fisher information fails. Neural Computation, 14(10), 2317-2351
12. Britten, K., Shadlen, M., Newsome,W., & Movshon, J. (1993). Responses of neurons in macaqueMT to stochasticmotion signals. Visual Neuroscience, 10(6), 1157-1169
13. Brown, W., & B¨acker, A. (2006). Optimal neuronal tuning for finite stimulus spaces. Neural Computation, 18(7), 1511-1526
14. Brunel, N., & Nadal, J. (1998). Mutual information, Fisher information, and population coding. Neural Computation, 10(7), 1731-1757
15. Carandini, M., & Heeger, D. (2012). Normalization as a canonical neural computation. Nature Reviews Neuroscience, 13(1), 51-62
16. Cover, T., & Thomas, J. (1991). Elements of information theory. New York: Wiley-Interscience
17. Cox, D., & Hinkley, D. (1974). Theoretical statistics. London: Chapman and Hall
18. Doi, E., Gauthier, J., Field, G., Shlens, J., Sher, A., Greschner, M.,... Simoncelli, E. P. (2012). Efficient coding of spatial information in the primate retina. J. Neuroscience, 32, 16256-16264
19. Fairhall, A., Lewen, G., Bialek,W., & de Ruyter van Steveninck, R. (2001). Efficiency and ambiguity in an adaptive neural code. Nature, 412(6849), 787-792
20. Fischer, B., & Peña, J. (2011). Owl's behavior and neural representation predicted by Bayesian inference. Nature Neuroscience, 14(8), 1061-1066
21. Ganguli, D. (2012). Efficient coding and Bayesian inference with neural populations. Doctoral dissertation, New York University, New York
22. Ganguli, D., & Simoncelli, E. (2010). Implicit encoding of prior probabilities in optimal neural populations. In J. Lafferty, C.Williams, J. Shawe-Taylor, R. Zemel,&A. Culotta (Eds.), Advances in neural information processing systems, 23 (pp. 658-666). Red Hook, NY: Curran
23. Ganguli, D., & Simoncelli, E. (2012). Neural implementation of Bayesian inference using efficient population codes. Presented at the Computational and Systems Neuroscience meeting, Salt Lake City, UT. http://www.cosyne.org/c/index.phd?title=cosyne _12
24. Geisler, W., Najemnik, J., & Ing, A. (2009). Optimal stimulus encoders for natural tasks. Journal of Vision, 9(13), 1-16
25. Georgopoulos, A., Schwartz, A., & Kettner, R. (1986). Neuronal population coding of movement direction. Science, 233(4771), 1416-1419
26. Gersho, A., & Gray, R. (1991). Vector quantization and signal compression. Norwell, MA: Kluwer Academic
27. Girshick, A., Landy, M., & Simoncelli, E. (2011). Cardinal rules: Visual orientation perception reflects knowledge of environmental statistics. Nature Neuroscience, 14(7), 926-932
28. Harper,N.,&McAlpine, D. (2004).Optimal neural population coding of an auditory spatial cue. Nature, 430(7000), 682-686
29. Helmholtz, H. (2000). Treatise on physiological optics. Bristol, UK: Thoemmes Press
30. Jazayeri, M., & Movshon, J. (2006). Optimal representation of sensory information by neural populations. Nature Neuroscience, 9(5), 690-696
31. Karklin, Y., & Simoncelli, E. (2011). Efficient coding of natural images with a population of noisy linear-nonlinear neurons. In J. Shawe-Taylor, R. S. Zemel, P. Bartlett, F.C.N. Pereira,&K.Q.Weinberger (Eds.), Advances in neural information processing systems, 24. Red Hook, NY: Curran
32. Knill, D., & Richards, W. (1996). Perception as Bayesian inference. Cambridge: Cambridge University Press
33. Kohn, A., & Smith, M. (2005). Stimulus dependence of neuronal correlation in primary visual cortex of the macaque. Journal of Neuroscience, 25(14), 3661- 3673
34. Kouh, M., & Poggio, T. (2008). A canonical neural circuit for cortical nonlinear operations. Neural Computation, 20(6), 1427-1451
35. Laughlin, S. (1981). A simple coding procedure enhances a neuron's information capacity. Zeitschrift F¨ur Naturforschung., 36(9-10), 910-912
36. Ma,W., Beck, J., Latham, P.,&Pouget, A. (2006). Bayesian inference with probabilistic population codes. Nature Neuroscience, 9(11), 1432-1438
37. McDonnell, M., & Stocks, N. (2008). Maximally informative stimuli and tuning curves for sigmoidal rate-coding neurons and populations. Physical Review Letters, 101(5), 58103
38. Montemurro, M., & Panzeri, S. (2006). Optimal tuning widths in population coding of periodic variables. Neural Computation, 18(7), 1555-1576
39. Nadal, J., & Parga, N. (1994). Non linear neurons in the low noise limit: A factorial code maximizes information transfer. Network: Computation in Neural Systems, 5, 565-581
40. Pouget, A.,Dayan, P.,&Zemel,R. (2003). Inference and computation with population codes. Annu. Rev. Neurosci., 26, 381-410
41. Pouget, A., Deneve, S., Ducom, J., & Latham, P. (1999). Narrow versus wide tuning curves: What's best for a population code? Neural Computation, 11(1), 85-90
42. Sahani, M., & Dayan, P. (2003). Doubly distributional population codes: Simultaneous representation of uncertainty and multiplicity. Neural Computation, 15(10), 2255-2279
43. Salinas, E., & Abbott, L. (1994). Vector reconstruction from firing rates. Journal of Computational Neuroscience, 1(1-2), 89-107
44. Sanger, T. (1996). Probability density estimation for the interpretation of neural population codes. J. Neurophysiol., 76(4), 2790-2793
45. Seri'es, P., Stocker,A.,&Simoncelli, E. P. (2009). Is the homunculus “aware“ of sensory adaptation? Neural Computation, 21(12), 3271-3304
46. Seung, H.,&Sompolinsky, H. (1993). Simple models for reading neuronal population codes. Proc. National Academy of Sciences, 90(22), 10749-10753
47. Shadlen, M. N.,&Newsome,W. T. (1998). The variable discharge of cortical neurons: Implications for connectivity, computation, and information coding. Journal of Neuroscience, 18(10), 3870-3896
48. Shamir, M., & Sompolinsky, H. (2006). Implications of neuronal diversity on population coding. Neural Computation, 18(8), 1951-1986
49. Shi, L., & Griffiths, T. (2009). Neural implementation of hierarchical bayesian inference by importance sampling. In Y. Bengio, D. Schuurmans, J. D. Lafferty, C. K. I Williams, & A. Culotta (Eds.), Advances in neural information processing systems, 22 (pp. 1669-1677). Red Hook, NY: Curran
50. Simoncelli, E. (1993). Distributed analysis and representation of visual motion. Doctoral dissertation, MIT
51. Simoncelli, E. P. (2003). Local analysis of visual motion. In L. M. Chalupa & J. S. Werner (Eds.), The visual neurosciences (pp. 1616-1623). Cambridge, MA: MIT Press
52. Simoncelli, E. (2009). Optimal estimation in sensory systems. In M. Gazzaniga (Ed.), The cognitive neurosciences (vol. 4, pp. 525-535). Cambridge, MA: MIT Press
53. Simoncelli, E., & Olshausen, B. (2001). Natural image statistics and neural representation. Annual Review of Neuroscience, 24(1), 1193-1216
54. Snippe, H. (1996). Parameter extraction frompopulation codes:Acritical assessment. Neural Computation, 8(3), 511-529
55. Stocker, A., & Simoncelli, E. (2006). Noise characteristics and prior expectations in human visual speed perception. Nature Neuroscience, 9(4), 578-585
56. Tkacˇik, G., Prentice, J. S., Balasubramanian, V., & Schneidman, E. (2010). Optimal population coding by noisy spiking neurons. Proc. National Academy of Sciences, 107(32), 14419-14424
57. Tolhurst, D., Movshon, J., & Dean, A. (1983). The statistical reliability of signals in single neurons in cat and monkey visual cortex. Vision Research, 23(8), 775-785
58. von der Twer, T., & MacLeod, D. (2001). Optimal nonlinear codes for the perception of natural colours. Network, 12(3), 395-407
59. Wang, Z., Stocker, A., & Lee, D. (2012). Optimal neural tuning curves for arbitrary stimulus distributions: Discrimax, infomax and minimum LP loss. In F. Pereira, C. J. C. Burges, L. Bottou,&K. Q.Weinberger (Eds.), Advances in neural information processing systems, 25 (pp. 2168-2176). Red Hook, NY: Curran
60. Wei, X., & Stocker, A. (2012a). Bayesian inference with efficient neural population codes. In Proceedings of the Int'l Conf on Artificial Neural Networks. New York: Springer
61. Wei, X., & Stocker, A. (2012b). Efficient coding provides a direct link between prior and likelihood in perceptual Bayesian inference. In F. Pereira, C. J. C. Burges, L. Bottou, & K.Q. Weinberger (Eds.), Advances in neural information processing systems, 25 (pp. 1313-1321)
62. Werner, G., & Mountcastle, V. B. (1963). The variability of central neural activity in a sensory system, and its implications for the central reflection of sensory events. Journal of Neurophysiology, 26(6), 958-977
63. Yang, J., Lee, J., & Lisberger, S. (2012). The interaction of Bayesian priors and sensory data and its neural circuit implementation in visually-guided movement. J Neurosci., 32, 17632-17645
64. Zemel, R., Dayan, P., & Pouget, A. (1998). Probabilistic interpretation of population codes. Neural Computation, 10(2), 403-430
65. Zhang, K., Ginzburg, I., McNaughton, B., & Sejnowski, T. (1998). Interpreting neuronal population activity by reconstruction: Unified framework with application to hippocampal place cells. Journal of Neurophysiology, 79(2), 1017-1044
66. Zhang, K., & Sejnowski, T. (1999). Neuronal tuning: To sharpen or broaden? Neural Computation, 11(1), 75-84
67. Zohary, E., Shadlen, M., & Newsome,W. (1994). Correlated neuronal discharge rate and its implications for psychophysical performance. Nature, 370(6485), 140-143. PMID:8022482