Multivariate maximum entropy identification, transformation, and dependence

Journal of Multivariate Analysis

Volumn 99, Issue 6, 2008, Pages 1217-1231

  Ebrahimi, Nader ^a   Soofi, Ehsan S ^b   Soyer, Refik ^c  

^a NORTHERN ILLINOIS UNIVERSITY   (United States)

^b UNIVERSITY OF WISCONSIN MILWAUKEE   (United States)

^c GEORGE WASHINGTON UNIVERSITY   (United States)

Author keywords

Bivariate distribution; Characterization; Dependence; Exponential family; Kullback Leibler information; Singular distribution

Indexed keywords

EID: 43049100799     PISSN: 0047259X     EISSN: 10957243     Source Type: Journal    
DOI: 10.1016/j.jmva.2007.08.004     Document Type: Article

References (22)

1. Arnold B.C., Castillo E., and Sarabia J.M. Conditional Specification of Statistical Models (1999), Springer, New York
2. Arnold B.C., Castillo E., and Sarabia J.M. Conditionally specified distributions: an introduction. Statist. Sci. 16 (2001) 249-274
3. Asadi M., Ebrahimi N., Hamedani G.G., and Soofi E.S. Information measures for Pareto distributions and order statistics. In: Balakrishnan N., Castillo E., and Sarabia J.M. (Eds). Advances on Distribution Theory and Order Statistics (2006), Birkhauser, Boston 207-223
4. Ash R.B. Information Theory (1965), Wiley, New York (reprinted in 1990 by Dover)
5. Aulogiaris G., and Zografos K. A Maximum Entropy Characterization of Symmetric Kotz Type and Burr Multivariate Distributions. Test 13 (2004) 65-83
6. Bemis B.M., Bain L.J., and Higgins J.J. Estimation and hypothesis testing for the parameters of bivariate exponential distribution. J. Amer. Statist. Assoc. 67 (1972) 927-929
7. Block H.B., and Basu A.P. A continuous bivariate exponential extension. J. Amer. Statist. Assoc. 69 (1974) 1031-1037
8. Cover T.M., and Thomas J.A. Elements of Information Theory (1991), Wiley, New York
9. Cuadras C.M., and Augé J. A continuous general multivariate distribution and its properties. Commun. Statist.-Theory and Methods 10 (1981) 339-353
10. Darbellay G.A., and Vajda I. Entropy expressions for multivariate continuous distributions. IEEE Transactions on Information Theory, IT 46 (2000) 709-712
11. Ebrahimi N., Kirmani S.N.U.A., and Soofi E.S. Dynamic multivariate information. J. Multivariate Anal. 98 (2007) 328-349
12. Gaver D.P., and Lewis P.A.W. First-order gamma sequences and point processes. Adv. Appl. Probab. 12 (1980) 727-745
13. Hutchinson T.P., and Lai C.D. Continuous Bivariate Distributions (1990), Emphasising Applications, Rumsby, Adelaide
14. Jaynes E.T. On the rationale of maximum-entropy methods. Proc. IEEE 70 (1982) 939-952
15. Kapur J.N. Maximum Entropy Models in Science and Engineering (1989), Wiley, New York
16. Kullback S. Information Theory and Statistics (1959), Wiley, New York (reprinted in 1968 by Dover)
17. Marshall A.W., and Olkin I. A multivariate exponential distribution. J. Amer. Statist. Assoc. 62 (1967) 30-44
18. Mihram G.A., and Hultquist R.A. A bivariate warning-time/failure-time distribution. J. Amer. Statist. Assoc. 62 (1967) 589-599
19. Muliere P., and Scarsini M. Characterization of a Marshall-Olkin type class of distributions. Ann. of Inst. Math. Statist. 39 (1987) 429-441
20. Nadarajah S., and Zografos K. Expressions for Rényi and Shannon entropies for bivariate distributions. Inform. Sci. 170 (2005) 173-189
21. Soofi E.S., Ebrahimi N., and Habibullah M. Information distinguishability with application to analysis of failure data. J. Amer. Statist. Assoc. 90 (1995) 657-668
22. Zografos K. On maximum entropy characterization of Pearson's Type II and VII multivariate distributions. J. Multivariate Anal. 71 (1999) 67-75