Fisher and Shannon information in finite neural populations

Neural Computation

Volumn 24, Issue 7, 2012, Pages 1740-1780

  Yarrow, Stuart ^a   Challis, Edward ^b   Seriès, Peggy ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL; ARTICLE; BIOLOGICAL MODEL; COMPUTER SIMULATION; FINITE ELEMENT ANALYSIS; HUMAN; MONTE CARLO METHOD; NERVE CELL; PHYSIOLOGY;

ANIMALS; COMPUTER SIMULATION; FINITE ELEMENT ANALYSIS; HUMANS; MODELS, NEUROLOGICAL; MONTE CARLO METHOD; NEURONS;

EID: 84868257206     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/NECO_a_00292     Document Type: Article

References (47)

1. Abbott, L. F., and Dayan, P. (1999). The effect of correlated variability on the accuracy of a population code. Neural Comput., 11, 91-101.
2. Averbeck, B. B., Latham, P. E., and Pouget, A. (2006). Neural correlations, population coding and computation. Nat. Rev. Neurosci., 7(5), 358-366.
3. Beck, J. M., Ma, W. J., Kiani, R., Hanks, T., Churchland, A. K., Roitman, J., et al. (2008). Probabilistic population codes for Bayesian decision making. Neuron, 60, 1142-1152.
4. Berens, P., Ecker, A. S., Gerwinn, S., Tolias, A. S., and Bethge, M. (2011). Reassessing optimal neural population codes with neurometric functions. Proc. Natl. Acad. Sci. USA, 108, 4423-4428.
5. Bethge, M., Rotermund, D., and Pawelzik, K. (2002). Optimal short-term population coding: When Fisher information fails. Neural Comput., 14(10), 2317-2351.
6. Bezzi,M., Samengo, I., Leutgeb, S., and Mizumori, S. J. (2002). Measuring information spatial densities. Neural Comput., 14, 405-420.
7. Borst, A., and Theunissen, F. E. (1999). Information theory and neural coding. Nat. Neurosci., 2, 947-957.
8. Brunel, N., and Nadal, J. (1998). Mutual information, Fisher information, and population coding. Neural Comput., 10, 1731-1757.
9. Butts, D. A. (2003). How much information is associated with a particular stimulus? Network, 14(2), 177-187.
10. Butts, D. A., and Goldman, M. S. (2006). Tuning curves, neuronal variability, and sensory coding. PLoS Biol., 4, 639-646.
11. Chelaru, M. I., and Dragoi, V. (2008). Efficient coding in heterogeneous neuronal populations. Proc. Natl. Acad. Sci. USA, 105, 16344-16349.
12. Clifford, C. W. (2002). Perceptual adaptation: Motion parallels orientation. Trends Cogn. Sci., 6, 136-143.
13. Cover, T. M.,and Thomas, J. A. (2006). Elements of information theory (2nd ed.). Hoboken, NJ: Wiley-Interscience.
14. Dean, I., Harper, N. S., and McAlpine, D. (2005). Neural population coding of sound level adapts to stimulus statistics. Nature Neuroscience., 8, 1684-1689.
15. DeWeese, M. R., and Meister,M. (1999). How to measure the information gained from one symbol. Network, 10, 325-340.
16. Durant, S., Clifford, C. W. G., Crowder, N. A., Price, N. S. C., and Ibbotson, M. R. (2007). Characterizing contrast adaptation in a population of cat primary visual cortical neurons using Fisher information. J. Opt. Soc. Am. A Opt. Image. Sci. Vis., 24, 1529-1537.
17. Ecker, A. S., Berens, P., Keliris, G. A., Bethge, M., Logothetis, N. K., and Tolias, A. S. (2010). Decorrelated neuronal firing in cortical microcircuits. Science, 327, 584-587.
18. Fairhall, A. L., Lewen, G. D., Bialek, W., and de Ruyter van Steveninck, R. R. (2001). Efficiency and ambiguity in an adaptive neural code. Nature, 412, 787-792.
19. Gutnisky, D. A.,and Dragoi, V. (2008). Adaptive coding of visual information in neural populations. Nature, 452, 220-224.
20. Harper, N. S., and McAlpine, D. (2004). Optimal neural population coding of an auditory spatial cue. Nature, 430, 682-686.
21. Heller, J., Hertz, J. A., Kjaer, T. W., and Richmond, B. J. (1995). Information flow and temporal coding in primate pattern vision. J. Comput. Neurosci., 2, 175-193.
22. Hol, K., and Treue, S. (2001). Different populations of neurons contribute to the detection and discrimination of visual motion. Vision Res., 41, 685-689.
23. Jenison, R. L., and Reale, R. A. (2003). Likelihood approaches to sensory coding in auditory cortex. Network, 14, 83-102.
24. Kang, K., Shapley, R., and Sompolinsky, H. (2004). Information tuning of populations of neurons in primary visual cortex. J. Neurosci., 24, 3726-3735.
25. Latham, P. E., and Nirenberg, S. (2005). Synergy, redundancy, and independence in population codes, revisited. J. Neurosci., 25, 5195-5206.
26. Machens, C. K., Gollisch, T., Kolesnikova, O., and Herz, V. M. (2005). Testing the efficiency of sensory coding with optimal stimulus ensembles. Neuron, 47, 447-456.
27. Metropolis, N., and Ulam, S. (1949). The Monte Carlo method. J. Am. Stat. Assoc., 44, 335-341.
28. Montgomery, N., and Wehr, M. (2010). Auditory cortical neurons convey maximal stimulus-specific information at their best frequency. J. Neurosci., 30, 13362-13366.
29. Nelken, I., and Chechik, G. (2007). Information theory in auditory research. Hear. Res., 229, 94-105.
30. Oram,M.W., F̈oldíak, P., Perrett, D. I.,and Sengpiel, F. (1998). The "ideal homunculus": Decoding neural population signals. Trends Neurosci., 21, 259-265.
31. Panzeri, S., Petersen, R. S., Schultz, S. R., Lebedev, M., and Diamond, M. E. (2001). The role of spike timing in the coding of stimulus location in rat somatosensory cortex. Neuron, 29, 769-777.
32. Paradiso, M. A. (1988). A theory for the use of visual orientation information which exploits the columnar structure of striate cortex. Biol. Cybern., 58, 35-49.
33. Quian Quiroga, R., and Panzeri, S. (2009). Extracting information from neuronal populations: information theory and decoding approaches. Nat. Rev. Neurosci., 10, 173-185.
34. Sanger, T. D. (2003). Neural population codes. Curr. Opin. Neurobiol., 13, 238-249. Sawtell, N. B., and Williams, A. (2008). Transformations of electrosensory encoding associated with an adaptive filter. J. Neurosci., 28, 1598-1612.
35. Sawtell, N. B., and Williams, A (2008). Transformations of electrosensoryencoding associated with an adaptive filter. J. Neurosci., 28, 1598-1612.
36. Serìes, P., Latham, P. E., and Pouget, A. (2004). Tuning curve sharpening for orientation selectivity: Coding efficiency and the impact of correlations. Nat. Neurosci., 7, 1129-1135.
37. Serìes, P., Stocker, A. A., and Simoncelli, E. P. (2009). Is the homunculus "aware" of sensory adaptation? Neural Comput., 21, 3271-3304.
38. Seung, H. S., and Sompolinsky, H. (1993). Simple models for reading neuronal population codes. Proc. Natl. Acad. Sci. USA, 90, 10749-10753.
39. Shamir,M., and Sompolinsky, H. (2004). Nonlinear population codes. Neural Comput., 16, 1105-1136.
40. Shannon, C. (1948). A mathematical theory of communication. Bell System Technical Journal, 27, 379-423.
41. Theunissen, F. E., and Miller, J. P. (1991). Representation of sensory information in the cricket cercal sensory system. II. Information theoretic calculation of system accuracy and optimal tuning-curve widths of four primary interneurons. J. Neurophysiol, 66, 1690-1703.
42. Tov́ee, M. J., Rolls, E. T., Treves, A., and Bellis, R. P. (1993). Information encoding and the responses of single neurons in the primate temporal visual cortex. J. Neurophysiol., 70, 640-654.
43. Victor, J. D. (2005). Spike train metrics. Curr. Opin. Neurobiol., 15, 585-592.
44. Victor, J., and Purpura, K. (1997). Metric-space analysis of spike trains: Theory, algorithms and application. Network-Computation in Neural Systems, 8, 127-164.
45. Wark, B., Lundstrom, B. N., and Fairhall, A. (2007). Sensory adaptation. Curr. Opin. Neurobiol., 17, 423-429.
46. Wilke, S. D., and Eurich, C. W. (2002). Representational accuracy of stochastic neural populations. Neural Comput., 14, 155-189.
47. Xie, X. (2002). Threshold behaviour of themaximumlikelihood method in population decoding. Network, 13, 447-456.