Anthropic correction of information estimates and its application to neural coding

IEEE Transactions on Information Theory

Volumn 56, Issue 2, 2010, Pages 890-900

  Gastpar, Michael C ^a,b   Gill, Patrick R ^c   Huth, Alexander G ^d   Theunissen, Frédéric E ^d  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b Department of Microelectronics   (Netherlands)

^c School of Operations Research and Industrial Engineering   (United States)

^d UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Anthropic principle; Information estimation; Neural coding; Neuron; Redundancy

Indexed keywords

ANTHROPIC PRINCIPLE; ASYMMETRIC INFORMATION; AUDITORY SYSTEMS; INFORMATION ESTIMATION; INFORMATION PROCESSING ARCHITECTURE; MUTUAL INFORMATIONS; NEGATIVE BIAS; NEURAL CODING; PLUG-INS; POSITIVE BIAS; RESPONSE DATA;

DATA PROCESSING; FEATURE EXTRACTION; INFORMATION THEORY; QUALITY ASSURANCE; REDUNDANCY;

ESTIMATION;

EID: 77649305982     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2009.2037053     Document Type: Article

References (30)

1. A. Borst and F. E. Theunissen, "Information theory and neural coding," Nature Neurosci., vol. 2, pp. 947-957, Nov. 1999.
2. F. Rieke, D. Warland, R. R. de Ruyter van Steveninck, and W. Bialek, Spikes: Exploring the Neural Code. Cambridge, MA: MIT Press, 1997.
3. A. Globerson, E. Stark, E. Vaadia, and N. Tishby, "The minimum information principle and its application to neural code analysis," Proc. Nat. Acad. Sci. USA, vol. 106, pp. 3490-3495, Mar. 2009.
4. F. Rieke, D. A. Bodnar, and W. Bialek, "Naturalistic stimuli increase the rate and efficiency of information transmission by primary auditory afferents," Proc. R. Soc. Lond. B, Biol. Sci., vol. 262, no. 1365, pp. 259-65, 1995.
5. A. Hsu, S. M. N. Woolley, T. E. Fremouw, and F. E. Theunissen, "Modulation power and phase spectrum of natural sounds enhance neural encoding performed by single auditory neurons," J. Neurosci., vol. 24, pp. 9201-9211, Oct. 2004.
6. I. Nelken, G. Chechik, T. D. Mrsic-Flogel, A. J. King, and J. W. H. Schnupp, "Encoding stimulus information by spike numbers and mean response time in primary auditory cortex," J. Comput. Neurosci., vol. 19, pp. 199-221, 2005.
7. F. E. Theunissen and J. P. Miller, "Representation of sensory information in the cricket cercal sensory system. II. information theoretic calculation of system accuracy and optimal tuning-curve widths of four primary interneurons," J. Neurophysiol., vol. 66, no. 5, pp. 1690-1703, 1991.
8. Y. Dan, J. J. Attick, and R. C. Reid, "Efficient coding of natural scenes in the lateral geniculate nucleus: Experimental test of a computational theory," J. Neurosci., vol. 16, pp. 3351-3362, 1996.
9. E. Schneidman, W. Bialek, and M. J. Berry II, "Synergy, redundancy, and independence in population codes," J. Neurosci., vol. 23, no. 37, pp. 11539-11553, 2003.
10. N. Narayanan, E. Kimchy, and M. Laubach, "Redundancy and synergy of neuronal ensembles in motor cortex," J. Neurosci., vol. 25, pp. 4207-4216, 2005.
11. J. R. Puchalla, E. Schneidman, R. A. Harris, and M. J. Berry, "Redundancy in the population code of the retina," Neuron, vol. 46, no. 3, pp. 493-504, 2005.
12. G. Chechik, M. J. Anderson, O. Bar-Yosef, E. D. Young, N. Tishby, and I. Nelken, "Reduction of information redundancy in the ascending auditory pathway," Neuron, vol. 51, pp. 359-368, 2006.
13. L. Paninski, "Estimation of entropy and mutual information," Neural Comput., vol. 15, no. 6, pp. 1191-1253, 2003.
14. B. B. Averbeck, P. E. Latham, and A. Pouget, "Neural correlations, population coding and computation," Nature Rev. Neurosci., vol. 7, pp. 358-366, May 2006.
15. N. Gordona, T. M. Shackletonb, A. R. Palmerb, and I. Nelken, "Responses of neurons in the inferior colliculus to binaural disparities: Insights from the use of fisher information and mutual information," J. Neurosci. Methods, vol. 169, pp. 391-404, Apr. 2008.
16. T. M. Cover and J. A. Thomas, Elements of Information Theory, 2nd ed. New York: Wiley, 2006.
17. B. Carter, "Large number coincidences and the anthropic principle in cosmology," in Proc. IAU Symp. 63, Confrontation of Cosmological Theories With Observational Data, Dordrecht, 1974, pp. 291-298.
18. X. Nguyen, M. J. Wainwright, and M. I. Jordan, "Nonparametric estimation of the likelihood ratio and divergence functionals," in Proc. IEEE Int. Symp. Inf. Theory, Nice, France, Jun. 2007, pp. 2016-2020.
19. Q. Wang, S. R. Kulkarni, and S. Verdú, "Divergence estimation of continuous distributions based on data-dependent partitions," IEEE Trans. Inf. Theory, vol. 51, no. 9, pp. 3064-3074, Sep. 2005.
20. J. Victor and K. Purpura, "Estimation of information in neuronal responses," Trends Neurosci., vol. 22, no. 12, p. 543, 1999.
21. J. D. Victor, "Binless strategies for estimation of information from neural data," Phys. Rev. E, Stat. Phys. Plasmas Fluids Relat. Interdiscip. Top., vol. 66, p. 51903, 2002.
22. S. Panzeri and A. Treves, "Analytical estimates of limited sampling biases in different information measures," Network, Comput. Neural Syst., no. 7, pp. 87-107, 1996.
23. V. Q. Vu, B. Yu, and R. E. Kass, "Coverage-adjusted entropy estimation," Stat. Med., vol. 26, no. 21, pp. 4039-60, 2007.
24. B. Efron, The Jackknife, the Bootstrap and Other Resampling Plans. Philadelphia, PA: SIAM, 1992.
25. A. Antos and I. Kontoyiannis, "Convergence properties of functional estimates for discrete distributions," Random Structures Algorithms, vol. 19, pp. 163-193, Oct. 2001.
26. S. P. Strong, R. Koberle, R. R. de Ruyter van Steveninck, and W. Bialek, "Entropy and information in neural spike trains," Phys. Rev. Lett., vol. 80, pp. 197-200, 1998.
27. D. S. Reich, F. Mechler, and J. D. Victor, "Independent and redundant information in nearby cortical neurons," Science, vol. 294, pp. 2566-2568, 2001.
28. C. K. Machens, M. B. Stemmler, P. Prinz, R. Krahe, B. Ronacher, and A. V. M. Herz, "Representation of acoustic communication signals in insect auditory receptors," J. Neurosci., vol. 21, no. 9, pp. 3215-3227, 2001.
29. A. Orlitsky and J. R. Roche, "Coding for computing," IEEE Trans. Inf. Theory, vol. 47, no. 2, pp. 903-917, Mar. 2001.
30. I. Csiszár and J. Körner, Information Theory: Coding Theorems for Discrete Memoryless Systems. New York: Academic, 1982.