The Jensen-Shannon divergence

Journal of the Franklin Institute

Volumn 334, Issue 2, 1997, Pages 307-318

  Menendez M L ^a   Pardo, J A ^b   Pardo, L ^b   Pardo, M C ^b  

^a UNIVERSIDAD POLITÉCNICA DE MADRID   (Spain)

^b UNIVERSIDAD COMPLUTENSE DE MADRID   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION THEORY; COMPUTER SIMULATION; PROBABILITY; STATISTICAL METHODS; VECTORS;

ASYMPTOTIC DIFFERENCES; JENSEN SHANNON DIVERGENCE;

PARAMETER ESTIMATION;

EID: 0031104083     PISSN: 00160032     EISSN: None     Source Type: Journal    
DOI: 10.1016/s0016-0032(96)00063-4     Document Type: Article

References (20)

1. J. Lin, "Divergence measures based on the Shannon entropy", IEEE Trans. Information Theory, Vol. 37, No. 1, pp. 145-151, 1991.
2. C. Shannon, "A mathematical theory of Communications", Bell. System. Tech. J., Vol. 27, pp. 379-423, 1948.
3. J. Burbea and C. R. Rao, "On the convexity of some divergence measures based on entropy functions", IEEE Trans. Information Theory, Vol. 28, pp. 489-495, 1982.
4. A. K. C. Wong and M. You, "Entropy and distance of random graphs with application to structural pattern recognition", IEEE Trans. Pattern Anal. Machine Intell., Vol. PAMI-7, No. 5, pp. 599-609, 1985.
5. I. Csiszár, "Information type measures of difference of probability distributions and indirect observations", Studia Sci. Mat. Hung., Vol. 2, pp. 299-318, 1967.
6. K. Pearson, "On the criterion that a given system of deviations from the probable in the case of a correlated system of variables is such that it can be reasonably supposed to have arisen from random sampling", Phil. Mag., Vol. 50, pp. 157-172, 1900.
7. T. R. C. Read and N. A. C. Cressie, "Goodness-of-fit Statistics for Discrete Multivariate Data". Springer-Verlag, 1988.
8. K. Zografos, "Asymptotic properties of φ-divergence statistics and its application in contingency tablesφ, Int. J. Mathematical Stat. Sci., Vol. 2, pp. 5-21, 1993.
9. M. L. Menéndez, D. Morales, L. Pardo and M. Salicrú, "Asymptotic behaviour and statistical applications of divergence measures in multinomial populations: A unified study", Statistical Papers, Vol. 36, pp. 1-29, 1995.
10. D. Morales, L. Pardo, M. Saalicrú and M. L. Menéndez 'Asymptotic properties of divergence statistics in astratified sampling and its applications to test statistical hypotheses", J. Statistical Planning and Inference, Vol. 38, pp. 201-222, 1994.
11. D. A. S. Fraser "Nonparametric Methods in Statistics", John Wiley, New York, 1957.
12. 2 test of goodness of fit", Annals of Mathematical Statistics, Vol. 23, pp. 315-345, 1952.
13. R. R. Bahadur, "Some Limit Theorems in Statistics", Society for Industrial and Applied Mathematics, Philadelphia, 1971.
14. N. Cressie and T. R. C. Read, "Multinomial goodness-of-fit tests", J. R. Statistical Soc. Series B, Vol. 46, pp. 440-464, 1984.
15. T. Bednarski and T. Ledwina, "A note on biasedness of tests of fit", Mathematische Operationsforschung und Statistik, Series Statistics, Vol. 9, pp. 191-193, 1978.
16. J. E. Cohen and H. B. Sackrowitz, "Unbiasedness of the chi-square, likelihood ratio, and other goodness of fit tests for the equal cell case", Annals of Statistics, Vol. 3, pp. 959-964, 1975.
17. M. L. Menéndez, J. A. Pardo, L. Pardo and M. C. Pardo, "Asymptotic approximations for the distributions of the (h, Φ)-divergence goodness-of-fit statistics: application to Renyi's statistics". To appear in Kybernetes, 1996.
18. T. R. C. Read, "Small sample comparisons for the power divergence goodness of fit statistics". J. Am. Stat. Assoc., Vol. 79, pp. 929-935, 1984.
19. J. K. Yarnold, "Asymptotic approximations for the probability that a sum of lattice random vectors lies in a convex set". Annals of Mathematical Statistics, Vol 43, pp. 1566-1580, 1972.
20. D. Morales, L. Pardo and I. Vajda, "Asymptotic divergence of estimates of discrete distributions". J. Statistical Planning and Inference, Vol. 48, pp. 347-369, 1995.