Maximum entropy characterizations of the multivariate Liouville distributions

Journal of Multivariate Analysis

Volumn 97, Issue 6, 2006, Pages 1272-1283

  Bhattacharya, Bhaskar ^a  

^a Southern Illinois University at Carbondale   (United States)

Author keywords

Dirichlet distribution; Gamma variables; I projections; Inverted Dirichlet distribution; Maximum entropy principle; Shannon entropy

Indexed keywords

EID: 33747591696     PISSN: 0047259X     EISSN: 10957243     Source Type: Journal    
DOI: 10.1016/j.jmva.2005.06.011     Document Type: Article

References (27)

1. Ahmed N.A., and Gokhale D.V. Entropy expressions and their estimators for multivariate distributions. IEEE. Trans. Inform. Theory 35 (1989) 688-692
2. Aulogiaris G., and Zografos K. A maximum entropy characterization of symmetric Kotz type and multivariate Burr distributions. Test 13 (2004) 65-83
3. Bhattacharya B., and Dykstra R. A general duality approach to I-projections. J. Statist. Plann. Inference 47 (1995) 203-216
4. Csiszár I. I-divergence geometry of probability distributions and minimization problems. Ann. Probab. 3 (1975) 146-158
5. Darbellay G.A., and Vajda T. Entropy expressions for multivariate continuous distributions. IEEE. Trans. Inform. Theory 46 (2000) 709-712
6. Edwards J. A Treatise on the Integral Calculus vol. 2 (1922), MacMillan, New York
7. Gokhale D.V. On entropy based goodness-of-fit tests. Comput. Statist. Data Anal. 96 (1983) 157-165
8. Guiasu S. A classification of the main probability distributions by minimizing the weighted logarithmic measure of deviation. Ann. Inst. Statist. Math. 42 (1990) 269-279
9. Gupta R.D., and Richards D.S.P. Multivariate Liouville distributions. J. Multivariate Anal. 23 (1987) 233-256
10. James A.T. Distributions of matrix variates and latents roots derived from normal samples. Ann. Math. Stat. 35 (1964) 475-501
11. Jaynes E.T. Information theory and statistical mechanics. Phys. Rev. 106 (1957) 620-630
12. Kagan A.M., Linnik Y.V., and Rao C.R. Characterization Problems in Mathematical Statistics (B. Ramachandran Trans.) (1973), Wiley, New York
13. Kapur J.N. Maximum Entropy Models in Engineering (1989), Wiley, New York
14. Karlin S., and Rinott Y. Classes of orderings of measures and related correlation inequalities-I Multivariate totally positive distributions. J. Multivariate Anal. 10 (1980) 467-498
15. Karlin S., and Rinott Y. Entropy inequalities for classes of probability distributions-II, The multivariate case. Adv. in Appl. Probab. 13 (1981) 325-351
16. Kullback S. Information Theory and Statistics (1959), Wiley, New York
17. Marshall A.W., and Olkin I. Theory of Majorization and Its Applications (1979), Wiley, New York
18. Mudholkar G.S., and Tian L. An entropy based characterization of the inverse Gaussian distribution and related goodness-of-fit test. J. Statist. Plann. Inference 102 (2002) 211-221
19. Peddada S.D., and Richards D.S.P. Entropy inequalities for some multivariate distributions. J. Multivariate Anal. 39 (1991) 202-208
20. Preda V. The student distribution and the maximum entropy. Ann. Inst. Statist. Math. 34 (1982) 335-338
21. Rao C.R. Linear Statistical Inference and Its Applications (1973), Wiley, New York
22. A. Rényi, On measures of entropy and information, Proceedings of the 4th Berkeley Symposium on Mathematical Statistics and Probability, vol. 1, 1961, pp. 541-561.
23. Shore J.E., and Johnson R.W. Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy. IEEE Trans. Inform. Theory 27 (1980) 26-37
24. Sivazlian B.D. On a multivariate extension of the gamma and beta distributions. SIAM J. Appl. Math. 41 (1981) 205-209
25. Vasicek O. A test for normality based on sample entropy. J. Roy. Statist. Soc. Ser. B 38 (1976) 54-59
26. Zografos K. On maximum entropy characterization of Pearson's type II and VII multivariate distributions. J. Multivariate Anal. 71 (1999) 67-75
27. Zografos K., and Nadarajah S. Expressions for Rényi and Shannon entropies for multivariate distributions. Statist. Probab. Lett. 71 (2005) 71-84