Relative log-concavity and a pair of triangle inequalities

Bernoulli

Volumn 16, Issue 2, 2010, Pages 459-470

  Yu, Yaming ^a  

^a 5226 Donald Bren Hall   (United States)

Author keywords

Bernoulli sum; Binomial approximation; Hoeffding's inequality; Maximum entropy; Minimum entropy; Negative binomial approximation; Poisson approximation; Relative entropy

Indexed keywords

EID: 77957570446     PISSN: 13507265     EISSN: None     Source Type: Journal    
DOI: 10.3150/09-BEJ216     Document Type: Article

References (31)

1. Barbour, A. D., Holst, L. and Janson, S. (1992). Poisson Approximation. Oxford Studies in Probability 2. Oxford: Clarendon Press. MR1163825
2. Barlow, R. E. and Proschan, F. (1975). Statistical Theory of Reliability and Life Testing. New York: Holt, Rinehart & Winston. MR0438625
3. Chen, L. H. Y. (1975). Poisson approximation for dependent trials. Ann. Probab. 3 534-545. MR0428387
4. Choi, K. P. and Xia, A. (2002). Approximating the number of successes in independent trials: Binomial versus Poisson. Ann. Appl. Probab. 12 1139-1148. MR1936586
5. Csiszár, I. and Shields, P. (2004). Information theory and statistics: A tutorial. Foundations and Trends in Communications and Information Theory 1 417-528.
6. Davenport, H. and Pólya, G. (1949). On the product of two power series. Canad. J. Math. 1 1-5. MR0027306
7. Dharmadhikari, S. and Joag-Dev, K. (1988). Unimodality, Convexity, and Applications. New York: Academic Press. MR0954608
8. Ehm, W. (1991). Binomial approximation to the Poisson binomial distribution. Statist. Probab. Lett. 11 7-16. MR1093412
9. Hardy, G. H., Littlewood, J. E. and Pólya, G. (1964). Inequalities. Cambridge, UK: Cambridge Univ. Press.
10. Harremoës, P. (2001). Binomial and Poisson distributions as maximum entropy distributions. IEEE Trans. Inform. Theory 47 2039-2041. MR1842536
11. Hoeffding, W. (1956). On the distribution of the number of successes in independent trials. Ann. Math. Statist. 27 713-721. MR0080391
12. Imhof, J. P. (1961). Computing the distribution of quadratic forms in normal variables. Biometrika 48 419-426. MR0137199
13. Johnson, O. (2007). Log-concavity and the maximum entropy property of the Poisson distribution. Stochastic Process. Appl. 117 791-802. MR2327839
14. Johnson, O., Kontoyiannis, I. and Madiman, M. (2008). On the entropy and log-concavity of compound Poisson measures. Preprint. Available at arXiv:0805.4112.
15. Karlin, S. and Novikoff, A. (1963). Generalized convex inequalities. Pacific J. Math. 13 1251-1279. MR0156927
16. Karlin, S. and Rinott, Y. (1981). Entropy inequalities for classes of probability distributions I: The univariate case. Adv. in Appl. Probab. 13 93-112. MR0595889
17. Karlin, S. and Studden, W. J. (1966). Tchebycheff Systems: With Applications in Analysis and Statistics. New York: Interscience. MR0204922
18. Kullback, S. (1959). Information Theory and Statistics. New York: Wiley. MR0103557
19. Kullback, S. and Leibler, R. A. (1951). On information and sufficiency. Ann. Math. Statist. 22 79-86. MR0039968
20. Le Cam, L. (1960). An approximation theorem for the Poisson binomial distribution. Pacific J. Math. 10 1181-1197. MR0142174
21. Liggett, T. M. (1997). Ultra logconcave sequences and negative dependence. J. Combin. Theory Ser. A 79 315-325. MR1462561
22. Mateev, P. (1978). The entropy of the multinomial distribution. Teor. Veroyatn. Primen. 23 196-198. MR0490451
23. Pemantle, R. (2000). Towards a theory of negative dependence. J. Math. Phys. 41 1371-1390. MR1757964
24. Shaked, M. and Shanthikumar, J. G. (1994). Stochastic Orders and Their Applications. New York: Academic Press. MR1278322
25. Shepp, L. A. and Olkin, I. (1981). Entropy of the sum of independent Bernoulli random variables and of the multinomial distribution. In Contributions to Probability 201-206. New York: Academic Press. MR0618689
26. Stein, C. (1986). Approximate Computation of Expectations. IMS Monograph Series 7. Hayward, CA: Inst. Math. Statist. MR0882007
27. Whitt, W. (1985). Uniform conditional variability ordering of probability distributions. J. Appl. Probab. 22 619-633. MR0799285
28. Yu, Y. (2008). On the maximum entropy properties of the binomial distribution. IEEE Trans. Inform. Theory 54 3351-3353. MR2450793
29. Yu, Y. (2008). On an inequality of Karlin and Rinott concerning weighted sums of i.i.d. random variables. Adv. in Appl. Probab. 40 1223-1226. MR2488539
30. Yu, Y. (2009). Stochastic ordering of exponential family distributions and their mixtures. J. Appl. Probab. 46 244-254. MR2508516
31. Yu, Y. (2009). On the entropy of compound distributions on nonnegative integers. IEEE Trans. Inform. Theory. 55 3645-3650.