Rényi divergence and majorization

IEEE International Symposium on Information Theory - Proceedings

Volumn , Issue , 2010, Pages 1335-1339

  Van Erven, Tim ^a   Harremoës, Peter ^b  

^a CWI   (Netherlands)

^b Copenhagen Business College ^*  (Denmark)

Author keywords

[No Author keywords available]

Indexed keywords

INFORMATION DIVERGENCE; KULLBACK LEIBLER DIVERGENCE; MAJORIZATION; MEASURE OF INFORMATION; RELATIVE ENTROPY; SHANNON'S ENTROPY;

INFORMATION THEORY; OPTIMIZATION; RANDOM VARIABLES;

ENTROPY;

EID: 77955705823     PISSN: 21578103     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISIT.2010.5513784     Document Type: Conference Paper

References (12)

1. E. Arikan, "An inequality on guessing and its application to sequential decoding," IEEE Trans. Inform. Theory, vol. 42, pp. 99-105, Jan. 1996.
2. A. Rényi, "On measures of entropy and information," in Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, vol. 1, pp. 547-561, 1961.
3. P. Harremoës, "Interpretations of Rényi entropies and divergences," Physica A: Statistical Mechanics and its Applications, vol. 365, pp. 57-62, June 2006.
4. F. Liese and I. Vajda, "On divergence and informations in statistics and information theory," IEEE Tranns. Inform. Theory, vol. 52, pp. 4394 - 4412, Oct. 2006.
5. A. L. Gibbs and F. E. Su, "On choosing and bounding probability metrics," International Statistical Review, vol. 70, pp. 419-435, 2002.
6. D. Aldous and P. Diaconis, "Strong uniform times and finite random walks," Advances in Applied Mathematics, vol. 8, pp. 69-97, 1987.
7. A. W. Marshall and I. Olkin, Inequalities: Theory of Majorization and its Applications. New York: Academic Press, 1979.
8. F. Cicalese and U. Vaccaro, "Supermodularity and subadditivity of the entropy on the majorization lattice," IEEE Trans. Inform. Theory, vol. 48, pp. 933-938, 2002.
9. P. Harremoës, "A new look on majorization," in Proceedings ISITA 2004, (Parma, Italy), pp. 1422-1425, Oct. 2004.
10. A. N. Gorban, P. A. Gorban, and G. Judge, "The markov ordering approach," Entropy, vol. 12, May 2010. To appear in a special Issue entitled "Entropy in Model Reduction".
11. T. Cover and J. A. Thomas, Elements of Information Theory. Wiley, 1991.
12. M. Klimesh, "Entropy measures and catalysis of bipartite quantum state transformations," in Proceedings 2004 IEEE International Symposium on Information Theory, p. 357, June 27 - Luly 2 2004.