Probability distributions of the logarithm of inter-spike intervals yield accurate entropy estimates from small datasets

Journal of Neuroscience Methods

Volumn 173, Issue 1, 2008, Pages 129-139

  Dorval, Alan D ^a  

^a Duke University   (United States)

Author keywords

Entropy estimation; Finite dataset bias; Firing pattern; Information theory; Inter spike interval

Indexed keywords

ARTICLE; COMPUTER MODEL; ENTROPY; NERVE CELL NETWORK; PRIORITY JOURNAL; PROBABILITY; SIMULATION; SPIKE WAVE;

EID: 54049088503     PISSN: 01650270     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jneumeth.2008.05.013     Document Type: Article

References (28)

1. Carlton AG. On the bias of information estimates. Psychol Bull 1969;71:108-9.
2. Chao A, Shen T. Nonparametric estimation of Shannon's index of diversity when there are unseen species in sample. Environ Ecol Stat 2003;10:429-43.
3. Dayan P, Abbott LF. Theoretical neuroscience. Cambridge, MA: MIT Press; 2001.
4. Dorval AD, White JA. Synaptic input statistics tune the variability and reproducibility of neuronal responses. Chaos 2006;16:26105.
5. Efron B, Tibshirani RJ. An introduction to the bootstrap. London: Chapman & Hall; 1993.
6. Gilboa G, Chen R, Brenner N. History-dependent multiple-time-scale dynamics in a single-neuron model. J Neurosci 2005;25:6479-89.
7. Gollisch T. Time-warp invariant pattern detection with bursting neurons. New J Phys 2008;10:15012.
8. Harris B. The statistical estimation of entropy in the non-parametric case. Wisconsin University Madison, Mathematics Research Center; 1975, 318.
9. Izhikevich EM. Dynamical systems in neuroscience. Cambridge, MA: MIT Press; 2007.
10. Koch K, McLean J, Segev R, Freed MA, Berry MJ, Balasubramanian V, et al. How much the eye tells the brain. Curr Biol 2006;16:1428-34.
11. Ma S. Calculation of entropy from data motion. J Stat Phys 1981;26:221-40.
12. MacKay DM, McCulloch WS. The limiting information capacity of a neuronal link. Bull Math Biophys 1952;14:127-35.
13. Miller G. Note on the bias of information estimates. In: Quastler H, editor. Information theory in psychology II-B. Glencoe, IL: Free Press; 1955.
14. Miller J, Grosjean F, Lomanto C. Articulation rate and its variability in spontaneous speech: a reanalysis and some implications. Phonetica 1984;41:215-25.
15. Newman MEJ. Power laws, Pareto distributions and Zipf's law. Contemp Phys 2005;46:323-51.
16. Newman RS, Sawusch JR. Perceptual normalization for speaking rate: effects of temporal distance. Percept Psychophys 1996;58:540-60.
17. Paninski L. Estimation of entropy and mutual information. Neural Comput 2003;15:1191-253.
18. Reinagel P, Godwin D, Sherman SM, Koch C. Encoding of visual information by LGN bursts. J Neurophysiol 1999;81:2558-69.
19. Rieke F, Warland D, Bialek W. Coding efficiency and information rates in sensory neurons. Europhys Lett 1993;22:151-6.
20. Rieke F, Warland D, de Ruyter van Steveninck R, Bialek W. Spikes. MIT Press: Cambridge, MA, 1997.
21. Selinger JV, Kulagina NV, O'Shaughnessy TJ, Ma W, Pancrazio JJ. Methods for characterizing interspike intervals and identifying bursts in neuronal activity. J Neurosci Methods 2007;162:64-71.
22. Shannon CE, Weaver W. The mathematical theory of communication. Urbanan, IL: University of Illinois Press; 1949.
23. Sigworth F, Sine SM. Data transformations for improved display and fitting of single-channel dwell time histograms. Biophys J 1987;52:1047-54.
24. Strong SP, Koberle R, de Ruyter van Steveninck RR, Bialek W. Entropy and information in neural spike trains. Phys Rev Lett 1998;80:197-200.
25. Treves A, Panzeri S. The upward bias in measures of information derived from limited data samples. Neural Comput 1995;7:399-407.
26. von Helversen D. Gesang es mannchens und lautschema desweibchens bei der feld-heuschrecke Chorthippus biguttulus (Orthoptera, Acrididae). J Comp Physiol A Neuroethol Sens Neural Behav Physiol 1972;81:381-422.
27. Wolpert DH, Wolf DR. Estimating functions of probability distributions from a finite set of samples, Part 1: Bayes estimators and the Shannon entropy. arXiv, 1994; arXiv>comp-gas:9403001.
28. Wolpert DH, Wolf DR. Estimating functions of probability distributions from a finite set of samples. Phys Rev E 1995;52:6841-54 [Erratum in Phys. Rev. E 54:6973].