Rényi entropy, guesswork moments, and large deviations

IEEE Transactions on Information Theory

Volumn 50, Issue 11, 2004, Pages 2794-2800

  Pfister, Charles E ^a   Sullivan, Wayne G ^b  

^a EPFL   (Switzerland)

^b DUBLIN INSTITUTE OF TECHNOLOGY   (Ireland)

Author keywords

[No Author keywords available]

Indexed keywords

COMMUNICATION CHANNELS (INFORMATION THEORY); DECODING; PROBABILITY DISTRIBUTIONS; PUBLIC KEY CRYPTOGRAPHY; SECURITY OF DATA; THEOREM PROVING;

CHANNEL DECODING; GUESSWORK MOMENTS; LARGE DEVIATION; RENYI ENTROPY; SOFIC SHIFT;

INFORMATION THEORY;

EID: 8144228441     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2004.836665     Document Type: Article

References (11)

1. E. Arikan, "An inequality on guessing and its application to sequential decoding," IEEE Trans. Inform. Theory, vol. 34, pp. 55-63, Jan. 1988.
2. A. Dembo and O. Zeitouni, Large Deviation Techniques and Applications. New York: Springer-Verlag, 1998.
3. [i#d-actions," Commun. Math. Phys., vol. 164, pp. 433-454, 1994.
4. J. T. Lewis, C.-E. Pfister, R. Russell, and W. G. Sullivan, " Reconstruction sequences and equipartition measures: An examination of the asymptotic equipartition property," IEEE Trans. Inform. Theory, vol. 43, pp. 1935-1947, Nov. 1997.
5. J. T. Lewis, C.-E. Pfister, and W. G. Sullivan, "Entropy, concentration of probability and conditional limit theorems," Markov Processes and Related Fields, vol. 1, pp. 319-386, 1995.
6. D. Lind and B. Marcus, Symbolic Dynamics and Coding. Cambridge, UK: Cambridge Univer. Press, 1995.
7. D. Malone and W. G. Sullivan, "Guesswork and entropy," IEEE Trans. Inform. Theory, vol. 50, pp. 525-526, Mar. 2004.
8. B. Marcus, "A note on periodic points for ergodic toral automorphisms," Monatshefte für Mathematik, vol. 89, pp. 121-129, 1980.
9. C.-E. Pfister and W. G. Sullivan, "Billingsley dimension on shift spaces," Nonlinearity, vol. 16, pp. 661-682, 2003.
10. A. Rényi, Probability Theory. Amsterdam, The Netherlands: North-Holland, 1970.
11. R. Rivest. (1992) The MD5 Message-Digest Algorithm. [Online]. Available: ftp://ftp.rfc-editor.org/in-notes/rfc1321.txt