Python for information theoretic analysis of neural data

Frontiers in Neuroinformatics

Volumn 3, Issue FEB, 2009, Pages

  Ince, Robin A A ^a   Petersen, Rasmus S ^a   Swan, Daniel C ^b   Panzeri, Stefano ^a,c  

^a UNIVERSITY OF MANCHESTER   (United Kingdom)

^b NEWCASTLE UNIVERSITY   (United Kingdom)

^c ISTITUTO ITALIANO DI TECNOLOGIA   (Italy)

Author keywords

Bias; E science; Entropy; Information theory; Maximum entropy; Neural coding; Python; Reference:

Indexed keywords

EID: 74349121745     PISSN: 16625196     EISSN: None     Source Type: Journal    
DOI: 10.3389/neuro.11.004.2009     Document Type: Article

References (50)

1. Amari, S. I. (2001). Information geometry on hierarchy of probability distributions. IEEE Trans. Inf. Theory 47, 1701-1711.
2. Arabzadeh, E., Panzeri, S., and Diamond, M. E. (2004). Whisker vibration information carried by rat barrel cortex neurons. J. Neurosci. 24, 6011-6020.
3. Averbeck, B. B., Latham, P. E., and Pouget, A. (2006). Neural correlations, population coding and computation. Nat. Rev. Neurosci. 7, 358-367.
4. Belitski, A., Gretton, A., Magri, C., Marayama, Y., Montemurro, M. A., Logothetis, N. K., and Panzeri, S. (2008). Low-frequency local field potentials and spikes in primary visual cortex convey independent visual information. J. Neurosci. 28, 5696-5709.
5. Borst, A., and Theunissen, F. E. (1999). Information theory and neural coding. Nat. Neurosci. 2, 947-957.
6. Cover, T. M., and Thomas, J. A. (2006). Elements of Information Theory, 2nd Edn. Hoboken, NJ, John Wiley & Sons.
7. Dan, Y., Alonso, J. M., Usrey, W. M., and Reid, R. C. (1998). Coding of visual information by precisely correlated spikes in the lateral geniculate nucleus. Nat. Neurosci. 1, 501-507.
8. Davis, T. A. (2004). Algorithm 832: UMFPACK V4. 3 - An unsymmetric-pattern multifrontal method. ACM Trans. Math. Soft. 30, 196-199.
9. de Ruyter van Steveninck, R., Lewen, G., Strong, S., Koberle, R., and Bialek, W. (1997). Reproducibility and variability in neural spike trains. Science 21, 1805-1808.
10. Fuhrmann Alpert, G., Sun, F., Handwerker, D., D'Esposito, M., and Knight, R. (2007). Spatio-temporal information analysis of event-related BOLD responses. Neuroimage 34, 1545-1561.
11. Gibson, F., Austin, J., Ingram, C., Fletcher, M., Jackson, T., Jessop, M., Knowles, A., Liang, B., Lord, P., Pitsilis, G., Periorellis, P., Simonotto, J., Watson, P., and Smith, L. (2008). The CARMEN Virtual Laboratory: Web- Based Paradigms for Collaboration in Neuroscience. 6th International Meeting on Substrate-Integrated Microelectrodes. Reutlingen, Germany.
12. Gray, C. M., Konig, P., Engel, A. K., and Singer, W. (1989). Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which refl ects global stimulus properties. Nature 338, 334-337.
13. Hatsopoulos, N. G., Ojakangas, C. L., Paninski, L., and Donoghue, J. P. (1998). Information about movement direction obtained from synchronous activity of motor cortical neurons. Proc. Natl. Acad. Sci. 95, 15706-15711.
14. Hausser, J., and Strimmer, K. (2008). Entropy inference and the James-Stein estimator. Preprint, arXiv:0811.3579v1.
15. Honey, C. J., Kotter, R., Breakspear, M., and Sporns, O. (2007). Network structure of cerebral cortex shapes functional connectivity on multiple time scales. Proc. Natl. Acad. Sci. 104, 10240-10245.
16. Jones, E., Oliphant, T., Peterson, P., et al. (2001). SciPy: Open Source Scientific Tools for Python. URL http://www.scipy.org/
17. Latham, P. E., and Nirenberg, S. (2005). Synergy, redundancy, and independence in population codes, revisited. J. Neurosci. 25, 5195-5206.
18. Lüdtke, N., Ince, R. A. A., Brown, M., Kell, D. B., and Panzeri, S. (2009). A comparative evaluation of entropy and variance based methods for sensitivity analysis. In Preparation.
19. Mastronarde, D. N. (1983). Correlated firing of cat retinal ganglion cells. I. Spontaneously active inputs to X- and Y-cells. J. Neurophysiol. 49, 303-324.
20. Miller, G. A. (1955). Note on the bias of information estimates. In Information Theory in Psychology: Problems and Methods, H. Quastler, ed. (Glencoe, Ill, Free Press), pp. 95-100.
21. Montemurro, M. A., Panzeri, S., Maravall, M., Alenda, A., Bale, M. R., Brambilla, M., and Petersen, R. S. (2007a). Role of precise spike timing in coding of dynamic vibrissa stimuli in somatosensory thalamus. J. Neurophysiol. 98, 1871-1882.
22. Montemurro, M. A., Senatore, R., and Panzeri, S. (2007b). Tight data-robust bounds to mutual information combining shuffling and model selection techniques. Neural Comput. 19, 2913-2957.
23. Montemurro, M. A., Rasch, M. J., Murayama, Y., Logothetis, N. K., and Panzeri, S. (2008). Phase-of-firing coding of natural visual stimuli in primary visual cortex. Curr. Biol. 18, 375-380.
24. Moré, J., Garbow, B., and Hillstrom, K. (1999). Minpack. URL http://www.netlib.org/minpack
25. Nemenman, I., Bialek, W., and de Ruyter van Steveninck, R. (2004). Entropy and information in neural spike trains: progress on the sampling problem. Phys. Rev. E 69, 56111.
26. Nemenman, I., Shafee, F., and Bialek, W. (2002). Entropy and inference, revisited. Adv. Neural. Inf. Process. Syst. 14, 95-100.
27. Nirenberg, S., and Victor, J. (2007). Analyzing the activity of large populations of neurons: how tractable is the problem? Curr. Opin. Neurobiol. 17, 397-400.
28. Panzeri, S. (1999). Correlations and the encoding of information in the nervous system. Proc. R. Soc. B 266, 1001-1012.
29. Panzeri, S., Magri, C., and Logothetis, N. (2008). On the use of information theory for the analysis of the relationship between neural and imaging signals. Magn. Reson. Imaging 26, 1015-1025.
30. Panzeri, S., Petersen, R., Schultz, S., Lebedev, M., and Diamond, M. (2001). The role of spike timing in the coding of stimulus location in rat somatosensory cortex. Neuron 29, 769-777.
31. Panzeri, S., Senatore, R., Montemurro, M., and Petersen, R. (2007). Correcting for the sampling bias problem in spike train information measures. J. Neurophysiol. 98, 1064-1072.
32. Panzeri, S., and Treves, A. (1996). Analytical estimates of limited sampling biases in different information measures. Netw. Comput. Neural Syst. 7, 87-107.
33. Perez, F., and Granger, B. (2007). Ipython: a system for interactive scientific computing. Comput. Sci. Eng. 9, 21-29.
34. Petersen, R., Brambilla, M., Bale, M., Alenda, A., Panzeri, S., Montemurro, M., and Maravall, M. (2008). Diverse and temporally precise kinetic feature selectivity in the VPm thalamic nucleus. Neuron 60, 890-903.
35. Petersen, R., Panzeri, S., and Diamond, M. (2001). Population coding of stimulus location in rat somatosensory cortex. Neuron 32, 503-514.
36. Pola, G., Thiele, A., Hoffmann, K., and Panzeri, S. (2003). An exact method to quantify the information transmitted by different mechanisms of correlational coding. Netw. Comput. Neural Syst. 14, 35-60.
37. Rieke, F., Bialek, W., Warland, D., and Van Steveninck, R. (1999). Spikes: Exploring the Neural Code. Bradford Book. Cambridge, MA, MIT Press.
38. Rubino, D., Robbins, K., and Hatsopoulos, N. (2006). Propagating waves mediate information transfer in the motor cortex. Nat. Neurosci. 9, 1549-1557.
39. Schneidman, E., Berry, M., II, Segev, R., and Bialek, W. (2006). Weak pairwise correlations imply strongly correlated network states in a neural population. Nature 440, 1007-1012.
40. Schneidman, E., Still, S., Berry, M., and Bialek, W. (2003). Network information and connected correlations. Phys. Rev. Lett. 91, 238701.
41. Schürmann, T., and Grassberger, P. (1996). Entropy estimation of symbol sequences. Chaos. 6, 414-427.
42. Shannon, C. (1948). A mathematical theory of communication. Bell Syst. Tech. J. 27, 379-423.
43. Shlens, J., Field, G., Gauthier, J., Grivich, M., Petrusca, D., Sher, A., Litke, A., and Chichilnisky, E. (2006). The structure of multi-neuron firing patterns in primate retina. J. Neurosci. 26, 8254.
44. Strong, S., Koberle, R., de Ruyter van Steveninck, R., and Bialek, W. (1998). Entropy and information in neural spike trains. Phys. Rev. Lett. 80, 197-200.
45. Tang, A., Jackson, D., Hobbs, J., Chen, W., Smith, J. L., Patel, H., Prieto, A., Petrusca, D., Grivich, M. I., Sher, A., Hottowy, P., Dabrowski, W., Litke, A. M., and Beggs, J. M. (2008). A maximum entropy model applied to spatial and temporal correlations from cortical networks in vitro. J. Neurosci. 28, 505-518.
46. Treves, A., and Panzeri, S. (1995). The upward bias in measures of information derived from limited data samples. Neural Comput. 7, 399-407.
47. van Rossum, G. (1995). Python Reference Manual. CWI Reports CS-R 9525.
48. Victor, J. (1999). Temporal aspects of neural coding in the retina and lateral geniculate. Netw. Comput. Neural Syst. 10, 1-66.
49. Victor, J. (2006). Approaches to information-theoretic analysis of neural activity. Biol. Theory 1, 302-316.
50. Waldert, S., Preissl, H., Demandt, E., Braun, C., Birbaumer, N., Aertsen, A., and Mehring, C. (2008). Hand movement direction decoded from MEG and EEG. J. Neurosci. 28, 1000-1008.