Kullback-Leibler divergence measure for multivariate skew-normal distributions

Entropy

Volumn 14, Issue 9, 2012, Pages 1606-1626

  Contreras Reyes, Javier E ^a,b   Arellano Valle, Reinaldo B ^c  

^a INSTITUTO DE FOMENTO PESQUERO   (Chile)

^b UNIVERSIDAD DE VALPARAÍSO   (Chile)

^c PONTIFICIA UNIVERSIDAD CATÓLICA DE CHILE   (Chile)

Author keywords

Cross entropy; Earthquakes; Jeffreys divergence; Kullback Leibler divergence; Nonparametric clustering; Skew normal

Indexed keywords

EID: 84867463940     PISSN: None     EISSN: 10994300     Source Type: Journal    
DOI: 10.3390/e14091606     Document Type: Article

References (33)

1. Shannon, C.E. A mathematical theory of communication. Bell Syst. Tech. J. 1948, 27, 379-423.
2. Kullback, S.; Leibler, R.A. On information and sufficiency. Ann. Math. Stat. 1951, 22, 79-86.
3. Frery, A.C.; Nascimento, A.; Cintra, R. Information theory and image understanding: An application to polarimetric SAR imagery. Chil. J. Stat. 2011, 2, 81-100.
4. Gupta, M.; Srivastava, S. Parametric Bayesian estimation of differential entropy and relative entropy. Entropy 2010, 12, 818-843.
5. Cover, T.M.; Thomas, J.A. Elements of Information Theory; Wiley & Son, Inc.: New York, NY, USA, 1991; p. 774.
6. Weiss, R., Cook, D. A graphical case statistic for assessing posterior influence. Biometrika 1992, 79, 51-55.
7. Arellano-Valle, R.B.; Galea-Rojas, M.; Iglesias, P. Bayesian sensitivity analysis in elliptical linear regression models. J. Stat. Plan. Infer. 2000, 86, 175-199.
8. Burnham, K.P.; Anderson, D.R. Model Selection and Inference: A Practical Information Theoretic Approach; Springer-Verlag: New York, NY, USA, 1998; p. 353.
9. Seghouane, A.K. New AIC corrected variants for multivariate linear regression model selection. IEEE Trans. Aerosp. Electron. Syst. 2011, 47, 1154-1165.
10. Seghouane, A.K. Multivariate regression model selection from small samples using Kullback's symmetric divergence. Signal Process. 2006, 86, 2074-2084.
11. Boltz, S.; Debreuve, E.; Barlaud, M. High-dimensional statistical measure for region-of-interest tracking. Trans. Img. Proc. 2009, 18, 1266-1283.
12. Póczos, B.; Szabó, Z.; Schneider, J. Nonparametric divergence estimators for independent subspace analysis. In Proceedings of the European Signal Processing Conference, Barcelona, Spain, 2 September 2011; pp. 1849-1853.
13. Durrani, T.S.; Zeng, X. Copula based divergence measures and their use in image registration. In Proceedings of the European Signal Processing Conference, Glasgow, Scotland, 24-28 August 2009; pp. 1309-1313.
14. van Erven, T.; Harremoës, P. Rényi divergence and majorization. In Proceedings of the 2010 IEEE International Symposium on Information Theory Proceedings, Amsterdam, The Netherlands, 13-18 June 2010; pp. 1335-1339.
15. Arellano-Valle, R.B.; Azzalini, A. On the unification of families of skew-normal distributions. Scand. J. Stat. 2006, 33, 561-574.
16. Arellano-Valle, R.B.; Genton, M.G. On fundamental skew distributions. J. Multivariate Anal. 2005, 96, 93-116.
17. Azzalini, A.; Capitanio, A. Statistical applications of the multivariate skew normal distributions. J. Roy. Stat. Soc. Ser. B 1999, 61, 579-602.
18. Azzalini, A.; Dalla-Valle, A. The multivariate skew-normal distribution. Biometrika 1996, 83, 715-726.
19. Javier, W.R.; Gupta, A.K. Mutual information for certain multivariate distributions. Far East J. Theor. Stat. 2009, 29, 39-51.
20. Arellano-Valle, R.B.; Contreras-Reyes, J.E.; Genton, M.G. Shannon entropy and mutual information for multivariate skew-elliptical distributions. Scand. J. Stat. 2012, doi:10.1111/j.1467-9469.2011.00774.x.
21. Genton, M.G. Skew-Elliptical Distributions and Their Applications: A Journey Beyond Normality; Chapman & Hall/CRC: Boca Raton, FL, USA, 2004; Edited Volume, p. 416.
22. Contreras-Reyes, J.E.; Azzalini, A. On the spatial correlation between areas of high coseismic slip and aftershock clusters of the Maule earthquake Mw=8.8. arXiv 2012, arXiv:1208.1517v1.
23. Azzalini, A.; Torelli, N. Clustering via nonparametric density estimation. Stat. Comput. 2007, 17, 71-80.
24. Ullah, A. Entropy, divergence and distance measures with econometric applications. J. Stat. Plan. Infer. 1996, 49, 137-162.
25. Kullback, S. The Kullback-Leibler distance. Am. Stat. 1987, 41, 340-341.
26. Genton, M.G.; He, L.; Liu, X. Moments of skew-normal random vectors and their quadratic forms. Stat. Probabil. Lett. 2001, 51, 319-325.
27. Gao, J.-H.; Zhang, B. Estimation of seismic wavelets based on the multivariate scale mixture of Gaussians model. Entropy 2010, 12, 14-33.
28. Servicio Sismológico. Departamento de Geofísica, Universidad de Chile, Chile. Available online: http://ssn.dgf.uchile.cl/ (accessed on 23 March 2012).
29. Azzalini, A. R package sn: The skew-normal and skew-t distributions (version 0.4-6). Universitá di Padova, Padova, Italy, 2008. Available online: http://cran.r-project.org/web/packages/sn (accessed on 6 May 2012).
30. Contreras-Reyes, J.E. R package skewtools: Tools for analyze skew-elliptical distributions and related models (version 0.1.1). Instituto de Fomento Pesquero, Valparaíso, Chile, 2012. Available online: http://cran.rproject.org/web/packages/skewtools (accessed on 6 May 2012).
31. R Development Core Team. R: A Language and environment for statistical Computing; R Foundation for Statistical Computing, Vienna, Austria, 2012; ISBN 3-900051-07-0. Available online: http://www.R-project.org (accessed on 5 May 2012).
32. Kupperman, M. Further applications of information theory to multivariate analysis and statistical Inference. Ph.D. dissertation, The George Washington, University, Washington, DC, USA, 1957, p. 270.
33. Salicrú, M.; Menéndez, M.L.; Pardo, L.; Morales, D. On the applications of divergence type measures in testing statistical hypothesis. J. Multivariate Anal. 1994, 51, 372-391.