Coverage-adjusted entropy estimation

Statistics in Medicine

Volumn 26, Issue 21, 2007, Pages 4039-4060

  Vu, Vincent Q ^a   Yu, Bin ^a   Kass, Robert E ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Entropy estimation; Neuronal data; Spike train

Indexed keywords

BIOSTATISTICS; CODING; COMPARATIVE STUDY; CONFERENCE PAPER; ENTROPY; NERVE CELL; PROBABILITY; SIMULATION; SPIKE WAVE; TASK PERFORMANCE; VARIANCE;

ACTION POTENTIALS; BIOMETRY; ENTROPY; HUMANS; LIKELIHOOD FUNCTIONS; MODELS, NEUROLOGICAL; MODELS, STATISTICAL; NEURONS; UNITED STATES;

EID: 34548391942     PISSN: 02776715     EISSN: 10970258     Source Type: Journal    
DOI: 10.1002/sim.2942     Document Type: Conference Paper

References (27)

1. Perkel DH, Bullock TH. Neural coding: a report based on an NRP work session. Neurosciences Research Program Bulletin 1968; 6:219-349.
2. Shannon CE. The mathematical theory of communication. Bell System Technical Journal 1948; 27:379-423.
3. Wiener N. Cybernetics: or Control and Communication in the Animal and the Machine. Wiley: New York, 1948.
4. MacKay DM, McCulloch WS. The limiting information capacity of a neuronal link. Bulletin of Mathematical Biophysics 1952; 14:127-135.
5. Rieke F, de Ruyter van Steveninck R, Bialek W. Spikes: Exploring the Neural Code. MIT Press: Cambridge, MA, 1997.
6. Borst A, Theunissen FE. Information theory and neural coding. Nature Neuroscience 1999; 2(11):947-957.
7. Chao A, Shen TJ. Nonparametric estimation of Shannon's index of diversity when there are unseen species in sample. Environmental and Ecological Statistics 2003; 10:429-443.
8. Horvitz DG, Thompson DJ. A generalization of sampling without replacement from a finite universe. Journal of the American Statistical Association 1952; 47(260):663-685.
9. Mächler M, Bühlmann P. Variable length Markov chains: methodology, computing and software. Technical Report 104, ETH Zurich, 2002.
10. Paninski L. Estimation of entropy and mutual information. Neural Computation 2003; 15:1191-1253.
11. Strong SP, Koberle R, de Ruyter van Steveninck R, Bialek W. Entropy and information in neural spike trains. Physical Review Letters 1998; 80(1):197-200.
12. Cover T, Thomas J. Elements of Information Theory. Wiley: New York, 1991.
13. Basharin GP. On a statistical estimate for the entropy of a sequence of independent random variables. Theory of Probability and its Applications 1959; 4:333-336.
14. Miller G. Note on the bias of information estimates. Information Theory in Psychology: Problems and Methods II-B. Free Press: Glencoe, IL, 1955; 95-100.
15. Antos A, Kontoyiannis I. Convergence properties of functional estimates for discrete distributions. Random Structures and Algorithms 2001; 19:163-193.
16. Victor JD. Asymptotic bias in information estimates and the exponential (bell) polynomials. Neural Computation 2000; 12:2797-2804.
17. Zahl S. Jackknifing an index of diversity. Ecology 1977; 58:907-913.
18. Wolpert D, Wolf D. Estimating functions of probability distributions from a finite set of samples. Physical Review E 1995; 52(6):6841-6853.
19. Nemenman I, Bialek W, de Ruyter van Steveninck R. Entropy and information in neural spike trains: progress on the sampling problem. Physical Review E 2004; 69(5):056111.
20. Wyner AJ, Foster D. On the lower limits of entropy estimation. IEEE Transactions on Information Theory 2003, submitted for publication.
21. Ashbridge J, Goudie IBJ. Coverage-adjusted estimators for mark-recapture in heterogeneous populations. Communications in Statistics-Simulation 2000; 29:1215-1237.
22. Good IJ. The population frequencies of species and the estimation of population parameters. Biometrika 1953; 40(3/4):237-264.
23. Robbins HE. Estimating the total probability of the unobserved outcomes of an experiment. The Annals of Mathematical Statistics 1968; 39(1):256-257.
24. McAllester D, Schapire RE. On the convergence rate of Good-Turing estimators. Proceedings of the 13th Annual Conference on Computational Learning Theory, Stanford University, Stanford, CA. Morgan Kaufmann: San Francisco, 2000; 1-6.
25. Theunissen FE, David SV, Singh NC, Hsu A, Vinje WE, Gallant JL. Estimating spatio-temporal receptive fields of auditory and visual neurons from their responses to natural stimuli. Network 2001; 12(3):289-316.
26. Hsu A, Woolley SMN, Fremouw TE, Theunissen FE. Modulation power and phase spectrum of natural sounds enhance neural encoding performed by single auditory neurons. The Journal of Neuroscience 2004; 24(41): 9201-9211.
27. Orlitsky A, Santhanam NP, Viswanathan K, Zhang J. On modeling profiles instead of values. Proceedings of the 20th Conference on Uncertainty in Artificial Intelligence, Banff, Canada, 2004; 426-435.