Estimating information rates with confidence intervals in neural spike trains

Neural Computation

Volumn 19, Issue 7, 2007, Pages 1683-1719

  Shlens, Jonathon ^a,b   Kennel, Matthew B ^b   Abarbanel, Henry D I ^b,c   Chichilnisky, E J ^a  

^a SALK INSTITUTE FOR BIOLOGICAL STUDIES   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACTION POTENTIAL; ANIMAL; ARTICLE; BAYES THEOREM; BIOLOGICAL MODEL; COMPUTER SIMULATION; ENTROPY; GUINEA PIG; PHYSIOLOGY; POISSON DISTRIBUTION; RETINA GANGLION CELL;

ACTION POTENTIALS; ANIMALS; BAYES THEOREM; COMPUTER SIMULATION; ENTROPY; GUINEA PIGS; MODELS, NEUROLOGICAL; POISSON DISTRIBUTION; RETINAL GANGLION CELLS;

EID: 34447249549     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/neco.2007.19.7.1683     Document Type: Article

References (87)

1. Abarbanel, H. D. I., Masuda, N., Rabinovich, M. I., & Turner, E. (2001). Distribution of mutual information. Physics Letters A, 281, 368-373.
2. Abarbanel, H. D., & Talathi, S. S. (2006). Neural circuitry for recognizing interspike interval sequences. Physical Review Letters, 96, 148104.
3. Aguera y Arcas, B., & Fairhall, A. (2003). Computation in a single neuron: Hodgkin and Huxley revisited. Neural Computation, 15, 1715-1749.
4. Amigo, J. M., Szczepanski, J., Wajnryb, E., & Sanchez-Vives, M. (2004). Estimating the entropy rate of spike trains via Lempel-Ziv complexity. Neural Computation, 16, 717-736.
5. Baccus, S. A., & Meister, M. (2002). Fast and slow contrast adaptation in retinal circuitry. Neuron, 36, 909-919.
6. Bair, W., & Koch, C. (1996). Temporal precision of spike trains in extrastriate cortex of the behaving macaque monkey. Neural Computation, 8, 1185-1202.
7. Berry, M. J., & Meister, M. (1998). Refractoriness and neural precision. Journal of Neuroscience, 18, 2200-2211.
8. Berry, M. J., Warland, D. K., & Meister, M. (1997). The structure and precision of retinal spike trains. Proceedings of the National Academies of Science, 94, 5411-5416.
9. Bezzi, M., Samengo, I., Leutbeg, S., & Mizmori, S. J. Y. (2002). Measuring information spatial densities. Neural Computation, 14, 405-420.
10. Bialek, W., Rieke, F., de Ruyter van Steveninck, R., & Warland, D. (1991). Reading a neural code. Science, 252, 1854-1857.
11. Borst, A., & Theunissen, F. (1999). Information theory and neural coding. Nature Neuroscience, 2, 947-957.
12. Brenner, N., Bialek, W., & de Ruyter van Steveninck, R. (2000). Adaptive rescaling maximizes information transmission. Neuron, 26, 695-702.
13. Brenner, N., Strong, S. P., Koberle, R., Bialek, W., & de Ruyter van Steveninck, R. (2000). Synergy in a neural code. Neural Computation, 12, 1531-1552.
14. Brillouin, L. (1956). Science and information theory. Orlando, FL: Academic Press.
15. Buracas, G., Zador, A., DeWeese, M., & Albright, T. (1998). Efficient discrimination of temporal patterns by motion-sensitive neurons in primate visual cortex. Neuron, 20, 959-969.
16. Butts, D. (2003). How much information is associated with a particular stimulus? Network, 14, 177-187.
17. Chichilnisky, E. J., & Kalmar, R. (2003). Temporal resolution of ensemble visual motion signals in primate retina. Journal of Neuroscience, 23, 6681-6689.
18. Cover, T. M., & Thomas, J. A. (1991). Elements of information theory. New York: Wiley.
19. Dan, Y., Alonso, J. M., Usrey, W. M., & Reid, R. E. (1998). Coding of visual information by precisely correlated spikes in the lateral geniculate nucleus. Nature Neuroscience, 1, 501-507.
20. Davison, A., Hinkley, D., Gill, R., Ripley, B., Ross, S., Stein, M., & Williams, D. (1997). Bootstrap methods and their applications. Cambridge: Cambridge University Press.
21. de Ruyter van Steveninck, R., & Bialek, W. (1988). Real-time performance of a movement sensitive neuron in the blowfly visual system: Coding and information transfer in short spike sequences. Proceedings of the Royal Society of London, Series B, 234, 379-414.
22. de Ruyter van Steveninck, R., Lewen, G. D., Strong, S. P., Koberle, R., & Bialek, W. (1997). Reproducibility and variability in neural spike trains. Science, 275, 1805-1808.
23. DeWeese, M., & Meister, M. (1999). How to measure the information gained from one symbol. Network, 10, 325-340.
24. Dimitrov, A. G., Miller, J. P., Gedeon, T., Aldworth, Z., & Parker, A. E. (2003). Analysis of neural coding through quantization with an information-based distortion measure. Network: Computation in Neural Systems, 14, 151-176.
25. Duda, R. O., Hart, P. E., & Stork, D. G. (2001). Pattern classification. New York: Wiley.
26. Fairhall, A., Lewen, G., Bialek, W., & de Ruyter van Steveninck, R. (2001). Efficiency and ambiguity in an adaptive neural code. Nature, 412, 787-792.
27. Fano, R. M. (1961). Transmission of information: A statistical theory of communications. Cambridge, MA: MIT Press.
28. Fellous, J. M., Tiesinga, P. H. E., Thomas, P. J., & Sejnowski, T. J. (2004). Discovering spike patterns in neuronal responses. Journal of Neuroscience, 24, 2989-3001.
29. Frechette, E. S., Sher, A., Grivich, M. I., Petrusca, D., Litke, A. M., & Chichilnisky, E. J. (2005). Fidelity of the ensemble code for visual motion in primate retina. Journal of Neurophysiology, 94, 119-135.
30. Gamerman, D. (1997). Markov chain Monte Carlo: Stochastic simulation of Bayesian inference. New York: CRC Press.
31. Gat, I., & Tishby, N. (1999). Synergy and redundancy among brain cells of behaving monkeys. In H. S. Kearns, S. Solla, & D. Conn (Eds.), Advances in neural information processing systems, 11 (pp. 465-471). Cambridge, MA: MIT Press.
32. Gawne, T. J., & Richmond, B. J. (1993). How independent are the messages carried by adjacent inferior temporal cortical neurons? Journal of Neuroscience, 13, 2758-2771.
33. Gilmore, R., & Lefranc, M. (2002). The topology of chaos: Alice in stretch and squeeze land. New York: Wiley.
34. Hastings, W. (1970). Monte Carlo sampling methods using Markov chains and their applications. Biometrica, 57, 97.
35. Hilborn, R. (2000). Chaos and nonlinear dynamics: An introduction for scientists and engineers. New York: Oxford University Press.
36. Keat, J., Reinagel, P., Reid, R. C., & Meister, M. (2001). Predicting every spike: A model for the responses of visual neurons. Neuron, 30, 803-817.
37. Kennel, M. B., & Mees, A. I. (2002). Context-tree modeling of observed symbolic dynamics. Physical Review E, 66, 056209.
38. Kennel, M., Shlens, J., Abarbanel, H. D. I., & Chichilnisky, E. J. (2005). Estimating entropy rates with Bayesian confidence intervals. Neural Computation, 7, 1531-1576.
39. Kontoyiannis, I., Algoet, P., Suhov, Y., & Wyner, A. (1998). Nonparametric entropy estimation for stationary processes and random fields with applications to English text. IEEE Transactions in Information Theory, 44, 1319-1327.
40. Lempel, A., & Ziv, J. (1976). On the complexity of finite sequences. IEEE Transactions in Information Theory, 22, 75-81.
41. Lewen, G. D., Bialek, W., & de Ruyter van Steveninck, R. R. (2001). Neural coding of naturalistic motion stimuli. Network: Computation in Neural Systems, 12, 317-329.
42. Lind, D., & Marcus, B. (1996). Symbolic dynamics and coding. Cambridge: Cambridge University Press.
43. Liu, R. C., Tzonev, S., Rebrik, S., & Miller, K. D. (2001). Variability and information in a neural code of the cat lateral geniculate nucleus. Journal of Neurophysiology, 86, 2789-2806.
44. London, M., Schreibman, A., Hausser, M., Larkum, M., & Segev, I. (2002). The information efficacy of a synapse. Nature Neuroscience, 5, 332-340.
45. MacKay, D. (2003). Information theory, inference and learning algorithms. Cambridge: Cambridge University Press.
46. MacKay, D., & McCulloch, W. (1952). The limiting information capacity of a neuronal link. Bulletin of Mathematical Biophysics, 14, 127-135.
47. Mainen, Z., & Sejnowski, T. (1995). Reliability of spike timing in neocortical neurons. Science, 268, 1503-1506.
48. Mastronarde, D. N. (1989). Correlated firing of retinal ganglion cells. Trends in Neuroscience, 12, 75-80.
49. Meister, M., & Berry, M. J. (1999). The neural code of the retina. Neuron, 22, 435-450.
50. Meister, M., Lagnado, L., & Baylor, D. A. (1995). Concerted signaling by retinal ganglion cells. Science, 270, 1207-1210.
51. Metropolis, N., Rosenbluth, M., Rosenbluth, A., Teller, M., & Teller, A. (1953). Equations of state calculations by fast computing machines. Journal of Chemical Physics, 21, 1087.
52. Miller, G., & Madow, W. (1954). On the maximum likelihood estimate of the Shannon-Wiener measure of information. Air Force Cambridge. Research Center Technical Report, 75, 54.
53. Nemenman, I., Bialek, W., & de Ruyter van Steveninck, R. (2004). Entropy and information in neural spike trains: Progress on the sampling problem. Physical Review E, 69.
54. Nemenman, I., Shafee, F., & Bialek, W. (2002). Entropy and inference, revisited. In T. G. Dietterich, S. Becker, & Z. Ghahramani (Eds.), Advances in neural information processsing systems, 14. Cambridge, MA: Cambridge University Press.
55. Nirenberg, S., & Latham, P. (2003). Decoding neuronal spike trains: How important are correlations? Proceedings of the National Academies of Science, 100, 7348-7353.
56. Ott, E. (2002). Chaos in dynamical systems. Cambridge: Cambridge University Press.
57. Paninski, L. (2003a). Estmation of entropy and mutual information. Neural Computation, 15, 1191-1254.
58. Paninski, L. (2003b). Convergence properties of three spike-triggered analysis techinques. Network: Computation in Neural Systems, 14, 437-464.
59. Paninski, L., Pillow, J., & Simoncelli, E. (2004). Maximum likelihood estimation of stochastic integrate-and-fire neural model. Neural Computation, 16, 2533-2561.
60. Pillow, J., & Simoncelli, E. (2003). Biases in white noise analysis due to non-Poisson spike generation. Neurocomputing, 52, 109-115.
61. Politis, D. N., & Romano, J. P. (1994). The stationary bootstrap. J. Amer. Stat. Assoc., 89, 1303-1313.
62. Politis, D. N., & White, H. (2004). Automatic block-length selection for dependent bootstrap. Econometric Review, 23, 53-70.
63. Puchalla, J., Schneidman, E., Harris, R., & Berry R. J. 11 (2005). Redundancy in the population code of the retina. Neuron, 46, 493-504.
64. Rapp, P. E., Zimmerman, I. D., Vining, E. P., Cohen, N., Albano, A. M., & Jimhez-Montaiio, M. A. (1994). The algorithmic complexity of neural spike trains increases during focal seizures. Journal of Neuroscience, 14, 4731-4739.
65. Reich, D. S., Mechler, F., & Victor, J. (2001). Information in nearby cortical neurons. Science, 294, 2566-2568.
66. Reinagel, P., & Reid, R. C. (2000). Temporal coding of visual information in the thalamus. Journal of Neuroscience, 20, 5392-5400.
67. Reinagel, P., & Reid, R. C. (2002). Precise firing events are conserved across neurons. Journal of Neuroscience, 22, 6837-6841.
68. Rieke, F., Bodnar, D., & Bialek, W. (1995). Naturalistic stimuli increase the rate and efficiency of information transmission by primary auditory afferents. Proceedings of the Royal Society of London B: Biological Sciences, 262, 259-265.
69. Rieke, F., Warland, D., de Ruyter van Steveninck, R., & Bialek, W. (1997). Spikes: Exploring the neural code. Cambridge, MA: MIT Press.
70. Rissanen, J. (1989). Stochastic complexity in statistical inquiry. Singapore: World Scientific.
71. Schneidman, E., Bialek, W., & Berry, M. J. (2003). Synergy, redundancy, and independence in population codes. Journal of Neuroscience, 23, 11539-11553.
72. Schnitzer, M. J., & Meister, M. (2003). Multineuronal firing patterns in the signal from eye to brain. Neuron, 37, 499-511.
73. Schurmann, T., & Grassberger, P. (1996). Entropy estimation of symbol sequences. Chaos, 6, 414-427.
74. Shannon, C. (1948). A mathematical theory of communication. Bell Systems Technology Journal, 27, 379-423.
75. Sharpee, T., Rust, N., & Bialek, W. (2004). Anaylzing neural responses to natural signals: Maximally informative dimensions. Neural Computation, 16, 223-250.
76. Simoncelli, E. P., & Olhausen, B. A. (2001). Natural image statistics and neural representation. Annual Review of Neuroscience, 24, 1193-1215.
77. Simoncelli, E. P., Paninski, L., Pillow, J., & Schwartz, O. (2004). Characterization of neural responses with stochastic stimuli. In M. Gazzaniga (Ed.), The cognitive neurosciences (3rd ed.). Cambridge, MA: MIT Press.
78. Stanley, G. B., Li, F. F., & Dan, Y. (1999). Reconstruction of natural scenes from ensemble responses in the lateral geniculate nucleus. Journal of Neuroscience, 19, 8036-8042.
79. Strong, S. P., Koberle, R., de Ruyter van Steveninck, R., & Bialek, W. (1998). Entropy and information in neural spike trains. Physical Review Letters, 80, 197-200.
80. Theunissen, F., & Miller, J. (1995). Temporal encoding in the nervous system: A rigorous definition. Journal of Computational Neuroscience, 2, 149-162.
81. Treves, A., & Panzeri, S. (1995). The upward bias in measures of information derived from limited data samples. Neural Computation, 7, 399-407.
82. Usrey, W. M., & Reid, R. C. (1999). Synchronous activity in the visual system. Annual Reviews in Physiology, 61, 435-456.
83. Uzzell, V. J., & Chichilnisky, E. J. (2004). Precision of spike trains in primate retinal ganglion cells. Journal of Neurophysiology, 92, 780-789.
84. Victor, J. D. (2002). Binless strategies for estimation of information from neural data. Physical Review E, 66, 051903.
85. Warland, D., Reinagel, P., & Meister, M. (1997). Decoding visual information from a population of retinal ganglion cells. Journal of Neurophysiology, 78, 2336-2350.
86. Willems, F. M. J., Shtarkov, Y. M., & Tjalkens, T. (1995). The context tree weighting method: Basic properties. IEEE Transactions in Information Theory, IT-41, 653-664.
87. Wolpert, D., & Wolf, D. (1995). Estimating functions of probability distributions from a finite set of samples. Physical Review E, 52, 6841-6854.