Bayesian entropy estimation for binary spike train data using parametric prior knowledge

Advances in Neural Information Processing Systems

Volumn , Issue , 2013, Pages

  Archer, Evan ^a   Park, Il Memming ^a   Pillow, Jonathan W ^a  

^a UNIVERSITY OF TEXAS AT AUSTIN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN NETWORKS; ENTROPY; MODELS;

ARBITRARY DISTRIBUTION; COMPACT REPRESENTATION; COMPUTATIONALLY EFFICIENT; DIRICHLET DISTRIBUTIONS; DISCRETE DISTRIBUTION; FUNDAMENTAL BUILDING BLOCKS; STATISTICAL FEATURES; STATISTICAL STRUCTURES;

ESTIMATION;

EID: 84899017600     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. K. H. Schindler, M. Palus, M. Vejmelka, and J. Bhattacharya. Causality detection based on informationtheoretic approaches in time series analysis. Physics Reports, 441:1-46, 2007.
2. A. Rényi. On measures of dependence. Acta Mathematica Hungarica, 10(3-4):441-451, 9 1959.
3. C. Chow and C. Liu. Approximating discrete probability distributions with dependence trees. Information Theory, IEEE Transactions on, 14(3):462-467, 1968.
4. A. Chao and T. Shen. Nonparametric estimation of Shannon's index of diversity when there are unseen species in sample. Environmental and Ecological Statistics, 10(4):429-443, 2003.
5. P. Grassberger. Estimating the information content of symbol sequences and efficient codes. Information Theory, IEEE Transactions on, 35(3):669-675, 1989.
6. S. Ma. Calculation of entropy from data of motion. Journal of Statistical Physics, 26(2):221-240, 1981.
7. S. Panzeri, R. Senatore, M. A. Montemurro, and R. S. Petersen. Correcting for the sampling bias problem in spike train information measures. J Neurophysiol, 98(3):1064-1072, Sep 2007.
8. L. Paninski. Estimation of entropy and mutual information. Neural Computation, 15:1191-1253, 2003.
9. W. Bialek, F. Rieke, R. R. de Ruyter van Steveninck, R., and D.Warland. Reading a neural code. Science, 252:1854-1857, 1991.
10. R. Strong, S. Koberle, de Ruyter van Steveninck R., and W. Bialek. Entropy and information in neural spike trains. Physical Review Letters, 80:197-202, 1998.
11. L. Paninski. Estimation of entropy and mutual information. Neural Computation, 15:1191-1253, 2003.
12. R. Barbieri, L. Frank, D. Nguyen, M. Quirk, V. Solo, M. Wilson, and E. Brown. Dynamic analyses of information encoding in neural ensembles. Neural Computation, 16:277-307, 2004.
13. M. Kennel, J. Shlens, H. Abarbanel, and E. Chichilnisky. Estimating entropy rates with Bayesian confidence intervals. Neural Computation, 17:1531-1576, 2005.
14. J. Victor. Approaches to information-theoretic analysis of neural activity. Biological theory, 1(3):302-316, 2006.
15. J. Shlens, M. B. Kennel, H. D. I. Abarbanel, and E. J. Chichilnisky. Estimating information rates with confidence intervals in neural spike trains. Neural Computation, 19(7):1683-1719, Jul 2007.
16. V. Q. Vu, B. Yu, and R. E. Kass. Coverage-adjusted entropy estimation. Statistics in medicine, 26(21):4039-4060, 2007.
17. V. Q. Vu, B. Yu, and R. E. Kass. Information in the nonstationary case. Neural Computation, 21(3):688-703, 2009, http://www.mitpressjournals.org/doi/ pdf/10.1162/neco.2008.01-08-700. PMID: 18928371.
18. E. Archer, I. M. Park, and J. Pillow. Bayesian estimation of discrete entropy with mixtures of stickbreaking priors. In P. Bartlett, F. Pereira, C. Burges, L. Bottou, and K. Weinberger, editors, Advances in Neural Information Processing Systems 25, pages 2024-2032. MIT Press, Cambridge, MA, 2012.
19. I. Nemenman, F. Shafee, and W. Bialek. Entropy and inference, revisited. In Advances in Neural Information Processing Systems 14, pages 471-478. MIT Press, Cambridge, MA, 2002.
20. M. Okun, P. Yger, S. L. Marguet, F. Gerard-Mercier, A. Benucci, S. Katzner, L. Busse, M. Carandini, and K. D. Harris. Population rate dynamics and multineuron firing patterns in sensory cortex. The Journal of Neuroscience, 32(48):17108-17119, 2012, http://www.jneurosci.org/content/32/48/17108.full. pdf+html.
21. G. Tkačik, O. Marre, T. Mora, D. Amodei, M. J. Berry II, and W. Bialek. The simplest maximum entropy model for collective behavior in a neural network. Journal of Statistical Mechanics: Theory and Experiment, 2013(03):P03011, 2013.
22. D. Wolpert and D. Wolf. Estimating functions of probability distributions from a finite set of samples. Physical Review E, 52(6):6841-6854, 1995.
23. I. M. Park, E. Archer, K. Latimer, and J. W. Pillow. Universal models for binary spike patterns using centered Dirichlet processes. In Advances in Neural Information Processing Systems (NIPS), 2013.
24. A. Panzeri, S. Treves, S. Schultz, and E. Rolls. On decoding the responses of a population of neurons from short time windows. Neural Computation, 11:1553-1577, 1999.