Logarithmic Sobolev inequalities for information measures

IEEE Transactions on Information Theory

Volumn 55, Issue 6, 2009, Pages 2554-2561

  Kitsos, Christos P ^a   Tavoularis, Nikolaos K ^a  

^a UNIVERSITY OF WEST ATTICA   (Greece)

Author keywords

Fisher's measure of information; Logarithmic Sobolev inequalities (LSIs); Shannon and R nyi entropy; Vajda measure of information

Indexed keywords

FISHER'S INFORMATION; FISHER'S MEASURE OF INFORMATION; GENERALIZED ENTROPIES; INFORMATION MEASURES; LOGARITHMIC SOBOLEV INEQUALITIES (LSIS); LOGARITHMIC SOBOLEV INEQUALITY; MEASURE OF INFORMATION; TYPE INFORMATION; VAJDA MEASURE OF INFORMATION;

FISHER INFORMATION MATRIX; LSI CIRCUITS;

ENTROPY;

EID: 66949148364     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2009.2018179     Document Type: Article

References (24)

1. G. Aulogiaris and K. Zografos, "A maximum entropy characterization of symmetric Kotz type and Burr multivariate distributions," Test, vol. 13, pp. 68-83, 2004.
2. W. Beckner, "Pitt's inequality and the uncertainty principle," in Proc. Amer. Math. Soc., 1995, vol. 123, no. 6, pp. 1897-1905.
3. N. M. Blachman, "The convolution inequality for entropy powers," IEEE Trans. Inf. Theory, vol. IT-11, no. 2, pp. 267-271, Apr. 1965.
4. E. A. Carlen, "Superadditivity of Fisher's information and logarithmic Sobolev inequalities," J. Funct. Anal., vol. 101, pp. 194-211, 1991.
5. A. Cotsiolis and N. K. Tavoularis, "On logarithmic Sobolev inequalities for higher order fractional derivatives," C. R. Acad. Sci. Ser. I vol. 340. Paris, France, pp. 205-208, 2005.
6. T. M. Cover and J. A. Thomas, Elements of Information Theory, 2nd ed. New York: Wiley, 2006.
7. K. Ferentinos and T. Papaioannou, "New parametric measures of information," Inf. Control, vol. 51, pp. 193-208, 1981.
8. G. A. Darbellay and I. Vajda, "Entropy expressions for multivariate continuous distributions," IEEE Trans. Inf. Theory, vol. 46, no. 2, pp. 709-712, Mar. 2000.
9. R. A. Fisher, "Theory of statistical estimation," in Proc. Cambridge Philos. Soc., 1925, vol. 22, pp. 700-725.
10. I. Ford, C. P. Kitsos, and D. M. Titterington, "Recent advances in nonlinear experimental design," Technometrics, vol. 31, pp. 49-60, 1989.
11. L. Gross, "Logarithmic Sobolev inequalities," Amer. J. Math., vol. 97, no. 761, pp. 1061-1083, 1975.
12. C. P. Kitsos, D. M. Titterington, and B. Torsney, "An optimal design problem in rhythmometry," Biometrics, vol. 44, pp. 657-671, 1988.
13. C. P. Kitsos, "Fully sequential procedures in nonlinear design problems," Comput. Statist. Data Anal., vol. 8, pp. 13-19, 1989.
14. C. P. Kitsos and C. Müller, "Robust linear calibration," Statistics, vol. 27, pp. 93-106, 1995.
15. C. P. Kitsos, "Optimal designs for estimating the percentiles of the risk in multistage models of carcinogenesis," Biometrical J., vol. 41, no. 1, pp. 33-43, 1999.
16. S. Kullback and A. Leibler, "On information and sufficiency," Ann. Math. Statist., vol. 22, pp. 79-86, 1951.
17. P-Euclidean logarithmic Sobolev inequality," J. Math. Anal. Appl., vol. 293, no. 2, pp. 375-388, 2004.
18. A. Rényi, "On measures of entropy and information," in Proc. 4th Berkeley Symp. Math. Statist. Prob., Berkeley, CA, 1961, vol. 1, pp. 579-561.
19. M. J. Schervish, Theory of Statistic. New York: Springer-Verlag, 1995.
20. C. E. Shannon, "A mathematical theory of communication," Bell System Tech. J., vol. 27, pp. 379-423, 623-656, 1948.
21. A. J. Stam, "Some inequalities satisfied by the quantities of information of Fisher and Shannon," Inf. Control, vol. 2, pp. 255-269, 1959.
22. 2-divergence and generalized Fisher's information," in Proc. 6th Prague Conf. Inf. Theory, Statist. Decision Functions Random Processes, 1973, pp. 873-886.
23. F. B. Weissler, "Logarithmic Sobolev inequalities for the heat-diffusion semigroup," Trans. Amer. Math. Soc., vol. 237, pp. 255-269, 1978.
24. K. Zografos and S. Nadarajah, "Expressions for Rényi and Shannon entropies for multivariate distributions," Statist. Probab. Lett. vol. 71, pp. 71-84, 2005.