Bayesian estimation of the entropy of the multivariate Gaussian

IEEE International Symposium on Information Theory - Proceedings

Volumn , Issue , 2008, Pages 1103-1107

  Srivastava, Santosh ^a   Gupta, Maya R ^b  

^a USA   (United States)

^b University of Washington   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN; BAYESIAN ESTIMATES; BAYESIAN ESTIMATIONS; BREG-MAN DIVERGENCES; ENTROPY ESTIMATOR; GAUSSIAN; INTERNATIONAL SYMPOSIUM; MULTIVARIATE GAUSSIAN; NEAREST-NEIGHBOR ENTROPY ESTIMATOR; WISHART DISTRIBUTION;

BAYESIAN NETWORKS; CYBERNETICS; ENTROPY; INFORMATION THEORY; PARAMETER ESTIMATION; STANDARDS; SYSTEMS ANALYSIS; TECHNICAL PRESENTATIONS; TRELLIS CODES;

ESTIMATION;

EID: 52349123628     PISSN: 21578101     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISIT.2008.4595158     Document Type: Conference Paper

References (17)

1. T. Cover and J. Thomas, Elements of Information Theory. United States of America: John Wiley and Sons, 1991.
2. A. Hero and O. Michel, "Asymptotic theory of greedy approximations to minimal k-point random graphs," IEEE Trans. Information Theory, vol. 45, pp. 1921-1939, 1999.
3. J. Costa and A. Hero, "Geodesic entropic graphs for dimension and entropy estimation in manifold learning," IEEE Trans. Signal Processing, vol. 52, no. 8, pp. 2210-2221, 2004.
4. J. Beirlant, E. Dudewicz, L. Györfi, and E. van der Meulen, "Nonparametric entropy estimation: An overview," International Journal Mathematical and Statistical Sciences, vol. 6, pp. 17-39, 1987.
5. N. Misra, H. Singh, and E. Demchuk, "Estimation of the entropy of a multivariate normal distribution," Journal of Multivariate Analysis, vol. 92, pp. 324-342, 2005.
6. N. A. Ahmed and D. V. Gokhale, "Entropy expressions and their estimators for multivariate distributions," IEEE Trans. Information Theory, pp. 688-692, 1989.
7. D. Endres and P. Földiàk, "Bayesian bin distribution inference and mutual information," IEEE Trans. Information Theory, pp. 3766-3779, 2005.
8. M. Nilsson and W. B. Kleijn, "On the estimation of differentia] entropy from data located on embedded manifolds," IEEE Trans. on Information Theory, vol. 53, no. 7, pp. 2330-2341, 2007.
9. L. F. Kozachenko and N. N. Leonenko, "Sample estimate of entropy of a random vector," Problems in Information Transmission, vol. 23, no. 1, pp. 95-101, 1987.
10. A. Hero, B. Ma, O. Michel, and J. Gorman, "Applications of entropic spanning graphs," IEEE Signal Processing Magazine, pp. 85-95, 2002.
11. J. Beardwood, J. H. Halton, and J. M. Hammersley, "The shortest path through many points." Proc. Cambridge Philo. Soc., vol. 55, pp. 299-327, 1959.
12. S. Srivastava, M. R. Gupta, and B. A. Frigyik, "Bayesian quadratic discriminant analysis," Journal of Machine Learning Research, vol. 8, pp. 1287-1314, 2007.
13. M. Bilodeau and D. Brenner, Theory of Multivariate Statistics. New York: Springer Texts in Statistics, 1999.
14. D. G. Keehn, "A note on learning for Gaussian properties," IEEE Trans. on Information Theory, vol. 11, pp. 126-132, 1965.
15. P. J. Brown, T. Fearn, and M. S. Haque, "Discrimination with many variables," Journal of the American Statistical Association, vol. 94, no. 448, pp. 1320-1329, 1999.
16. A. Banerjee, X. Guo, and H. Wang, "On the optimality of conditional expectation as a Bregman predictor," IEEE Trans. on Information Theory, vol. 51, no. 7, pp. 2664-2669, 2005.
17. B. A. Frigyik, S. Srivastava, and M. R. Gupta, "Functional Bregman divergence and Bayesian estimation of distributions," arXiv preprint cs.IT/0611123, 2006.