Shannon Entropy and Mutual Information for Multivariate Skew-Elliptical Distributions

Scandinavian Journal of Statistics

Volumn 40, Issue 1, 2013, Pages 42-62

  Arellano Valle, Reinaldo B ^a   Contreras Reyes, Javier E ^b   Genton, Marc G ^c  

^a PONTIFICIA UNIVERSIDAD CATÓLICA DE CHILE   (Chile)

^b UNIVERSITY OF CHILE   (Chile)

^c TEXAS A AND M UNIVERSITY   (United States)

Author keywords

Elliptical distribution; Entropy; Information theory; Optimal network design; Shannon; Skew normal; Skew t

Indexed keywords

EID: 84873995341     PISSN: 03036898     EISSN: 14679469     Source Type: Journal    
DOI: 10.1111/j.1467-9469.2011.00774.x     Document Type: Article

References (31)

1. Ahmed, N. A. & Gokhale, D. V. (1989). Entropy expressions and their estimators for multivariate distributions. IEEE Trans. Inform. Theory 35, 688-692.
2. Ainslie, B., Reuten, C., Steyn, D. G., Le, N. D. & Zidek, J. V. (2009). Application of an entropy-based Bayesian optimization technique to the redesign of an existing monitoring network for single air pollutants. J. Environ. Manage. 90, 2715-2729.
3. Arellano-Valle, R. B. (2010). On the information matrix of the multivariate skew-t model. Metron 68, 371-386.
4. Arellano-Valle, R. B. & Azzalini, A. (2006). On the unification of families of skew-normal distributions. Scand. J. Statist. 33, 561-574.
5. Arellano-Valle, R. B. & Bolfarine, H. (1995). On some characterizations of the t-distribution. Statist. Probab. Lett. 25, 179-185.
6. Arellano-Valle, R. B. & Genton, M. G. (2005). On fundamental skew distributions. J. Multivariate Anal. 96, 93-116.
7. Arellano-Valle, R. B. & Genton, M. G. (2010a). Multivariate extended skew-t distributions and related families. Metron 68, 201-234.
8. Arellano-Valle, R. B. & Genton, M. G. (2010b). Multivariate unified skew-elliptical distributions. Special issue 'Tribute to Pilar Loreto Iglesias Zuazola'. Chil. J. Stat. 1, 17-33.
9. Arellano-Valle, R. B. & Genton, M. G. (2010c). An invariance property of quadratic forms in random vectors with a selection distribution, with application to sample variogram and covariogram estimators. Ann. Inst. Statist. Math. 62, 363-381.
10. Arellano-Valle, R. B., Branco, M. D. & Genton, M. G. (2006a). A unified view on selection distributions. Canad. J. Statist. 33, 561-574.
11. Arellano-Valle, R. B., del Pino, G. & Iglesias, P. (2006b). Bayesian inference in spherical linear models: robustness and conjugate analysis. J. Multivariate Anal. 97, 179-197.
12. Azzalini, A. (2008). R package sn: the skew-normal and skew-t distributions (version 0.4-6). Universitá di Padova, Italia.
13. Azzalini, A. & Capitanio, A. (1999). Statistical applications of the multivariate skew normal distributions. J. Roy. Statist. Soc. Ser. B 61, 579-602.
14. Azzalini, A. & Capitanio, A. (2003). Distributions generated by perturbation of symmetry with emphasis on a multivariate skew t-distribution. J. Roy. Statist. Soc. Ser. B 65, 367-389.
15. Azzalini, A. & Dalla Valle, A. (1996). The multivariate skew-normal distribution. Biometrika 83, 715-726.
16. Branco, M. D. & Dey, D. K. (2001). A general class of multivariate skew-elliptical distributions. J. Multivariate Anal. 79, 99-113.
17. Cover, T. M. & Thomas, J. A. (2006). Elements of information theory. Second edn. Wiley, New Jersey.
18. Fang, K.-T., Kotz, S. & Ng, K.-W. (1990). Symmetric multivariate and related distributions. Monographs on Statistics and Applied Probability 36. Chapman and Hall, Ltd., London.
19. Genton, M. G. (2004). Skew-elliptical distributions and their applications: a journey beyond normality. Edited Volume, Chapman & Hall/CRC, Boca Raton, FL, 416 pp.
20. Gupta, A. K. (2003). Multivariate skew-t distribution. Statistics 37, 359-363.
21. Javier, W. R. & Gupta, A. K. (2008). Mutual information for the mixture of two multivariate normal distributions. Far East J. Theor. Stat. 26, 47-58.
22. Javier, W. R. & Gupta, A. K. (2009). Mutual information for certain multivariate distributions. Far East J. Theor. Stat. 29, 39-51.
23. Kullback, S. (1978). Information theory and statistics. Dover Edition, Gloucester.
24. Lee, S., Genton, M. G. & Arellano-Valle, R. B. (2010). Perturbation of numerical confidential data via skew-t distributions. Manag. Sci. 56, 318-333.
25. Ma, Y. & Genton, M. G. (2004). A flexible class of skew-symmetric distributions. Scand. J. Statist. 31, 459-468.
26. Mardia, K. V. (1985). Mardia's test of multinormality. In Encyclopedia of statistical sciences (eds N. Johnson & S. Kotz ), 217-221. Wiley, New York.
27. Misra, N., Singh, H. & Demchuk, E. (2005). Estimation of the entropy of a multivariate normal distribution. J. Multivariate Anal. 92, 324-342.
28. R Development Core Team (2010). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. ISBN 3-900051-07-0. Available on http://www.R-project.org.
29. Seremi de Salud (2006). Indices de Calidad del Aire, Santiago de Chile. Available on http://www.seremisaludrm.cl/sitio/pag/aire/indexjs3aireindgasesdemo-prueba.asp.
30. Shannon, C. E. (1948). A mathematical theory of communication. Bell Syst. Tech. J. 27, 379-423, 623-656.
31. Silva, C. & Quiroz, A. (2003). Optimization of the atmospheric pollution monitoring network at Santiago de Chile. Atmos. Environ. 37, 2337-2345.