Information Theoretic Inequalities

IEEE Transactions on Information Theory

Volumn 37, Issue 6, 1991, Pages 1501-1518

  Dembo, Amir ^a   Cover, Thomas M ^a   Thomas, Joy A ^a  

^a STANFORD UNIVERSITY   (United States)

Author keywords

entropy power; Fisher; information; Information inequalities; uncertainty principles

Indexed keywords

EID: 84941428932     PISSN: 00189448     EISSN: 15579654     Source Type: Journal    
DOI: 10.1109/18.104312     Document Type: Article

References (40)

1. D. Bakry and M. Emery, “Seminaire de Probabilities XIX,” in Lecture Notes in Mathematics, 1123. New York: Springer, 1985, pp. 179–206.
2. A. Barron, “Entropy and the central limit theorem,” Ann. Probab., vol. 14, no. 1, pp. 336–342, 1986.
3. W. Beckner, “Inequalities in Fourier analysis,” Ann. Math., vol. 102, 159–182, 1975.
4. R. Bellman, “Notes on matrix theory—IV: An inequality due to Bergstr0m,” Amer. Math. Monthly, vol. 62, pp. 172–173, 1955.
5. P. P. Bergmans, “A simple converse for broadcast channels with additive white normal noise,” IEEE Trans. Inform. Theory, vol. IT-20, pp. 279–280, 1974.
6. N. Blachman, “The convolution inequality for entropy powers,” IEEE Trans. Inform. Theory, vol. IT-11, pp. 267–271, Apr. 1965.
7. H. J. Brascamp and E. J. Lieb, “Some inequalities for Gaussian measures and the long range order of the one dimensional plasma,” in Functional Integration and Its Applications, A. M. Arthors, Ed. Oxford: Clarendon Press, 1975.
8. H. J. Brascamp and E. J. Lieb, “Best constants in Young’s inequality, its converse and its generalization to more than three functions,” Adv. Math., vol. 20, pp. 151–173, 1976.
9. H. J. Brascamp and E. J. Lieb, “On extensions of the Brunn-Minkowski and Prekopa-Leindler theorems, including inequalities for log concave functions, and with an application to the diffusion equation,” J. Functional Anal., vol. 22, pp. 366–389, 1976.
10. Y. D. Burago and V. A. Zalgaller, Geometric Inequalities. New York: Springer Verlag, 1980.
11. E. A. Carlen, “Some integral identities and inequalities for entire functions and their application to the coherent state transform,” J. Functional Anal., 1991.
12. E. A. Carlen, “Superadditivity of Fisher’s information and logarithmic Sobolev inequalities,” J. Functional Anal., 1991.
13. E. A. Carlen and A. Soffer, “Entropy production by convolution and central limit theorems with strong rate information,” Commun. Math. Phys., 1991.
14. M. Costa and T. M. Cover, “On the similarity of the entropy power inequality and the Brunn-Minkowski inequality,” IEEE Trans. Inform. Theory, vol. IT-30, pp. 837–839, 1984.
15. M. H. M. Costa, “A new entropy power inequality,” IEEE Trans. Inform. Theory, vol. IT-31, pp. 751–760, 1985.
16. T. M. Cover and J. A. Thomas, “Determinant inequalities via information theory,” SIAM J. Matrix Anal. and its Applicat., vol. 9, no. 3, pp. 384–392, July 1988.
17. T. M. Cover and A. El Gamal, “An information theoretic proof of Hadamard’s inequality,” IEEE Trans. Inform. Theory, vol. IT-29, pp. 930–931, Nov. 1983.
18. I. Csiszar, “Informationstheoretische konvegenenzbegriffe im raum der vahrscheinlichkeitsverteilungen,” Publ. Math. Inst., Hungarian Academy of Sci., VII, ser. A, pp. 137–157, 1962.
19. A. Dembo, “A simple proof of the concavity of the entropy power with respect to the variance of additive normal noise,” IEEE Trans. Inform. Theory, vol. 35, pp. 887–888, July 1989.
20. A. Dembo, “Information inequalities and uncertainty principles,” Tech. Rep., Dept. of Statist., Stanford Univ., Stanford, CA, 1990.
21. D. L. Donoho and P. B. Stark, “Uncertainty principles and signal recovery,” SIAM J. Appl. Math., vol. 49, pp. 906–931, 1989.
22. K. Fan, “On a theorem of Weyl concerning the eigenvalues of linear transformations II,” Proc. National Acad. Sci. U.S., vol. 36, 1950, 31–35.
23. K. Fan, “Some inequalities concerning positive-definite matrices,” Proc. Cambridge Phil. Soc., vol. 51, 1955, pp. 414–421.
24. H. Federer, Geometric measure theory, vol. B 153 of Grundl. Math. fViss. Berlin: Sgringer-Verlag, 1969.
25. L. Gross, “Logarithmic Sobolev inequalities,” Amer. J. Math., vol. 97, pp. 1061–1083, 1975.
26. L. Gross, “Logarithmic Sobolev inequalities for the heat kernel on a Lie group,” in Wite Noise Analysis. Singapore: World Scientific, 1990.
27. T. S. Han, “Nonnegative entropy measures of multivariate symmetric correlations,” Inform. Contr., vol. 36. pp. 133–156, 1978.
28. I. I. Hirschman, “A note on entropy,” Amer. J. Math., vol. 79, pp. 152–156, 1957.
29. S. Kullback, “A lower bound for discrimination information in terms of variation,” IEEE Trans. Inform. Theory, vol. IT-4, pp. 126–127, 1967.
30. E. H. Lieb, “Proof of an entropy conjecture of Wehrl,” Commun. Math. Phys., vol. 62, pp. 35–41, 1978.
31. E. H. Lieb, “Gaussian kernels have Gaussian maximizers.” Inventions Math., vol. 102, pp. 179–208, 1990.
32. A. Marshall and I. Olkin, In equalities: Theoty of Majorization and its Applications. New York: Academic Press, 1979.
33. A. Marshall and I. Olkin, “A convexity proof of Hadamard’s inequality,” Amer. Math. Monthly, vol. 89, pp. 687–688. 1982.
34. H. Minkowski, “Diskontinuitátsbereich für arithmetische äquivalenz,” J. für Math., vol. 129, pp. 220–274, 1950.
35. L. Mirsky, “On a generalization of Hadamard’s determinantal inequality due to Szasz,” Arch. Math., vol. 8, pp. 274–275, 1957.
36. A. Oppenheim, “Inequalities connected with definite Hermitian forms,” J. Lon. Math. Soc., vol. 5, pp. 114–119, 1930.
37. C. E. Shannon, “A mathematical theory of communication,” Bell Syst. Tech. J., vol. 27, pp, 379–423, 623–656, 1948.
38. A. Stam, “Some inequalities satisfied by the quantities of information of Fisher and Shannon,” Inform. Contr., vol. 2. pp. 101–112, 1959.
39. A. Wehrl, “General properties of entropy,” Rev. Modern Phys., vol. 50, pp. 221-260, 1978.
40. M. Zakai, “A class of definitions of ‘duration’ (or ‘uncertainty’) and the associated uncertainty relations,” Inform. Contr., vol. 3, pp. 101–115, 1960.