Second-order asymptotics in fixed-length source coding and intrinsic randomness

IEEE Transactions on Information Theory

Volumn 54, Issue 10, 2008, Pages 4619-4637

  Hayashi, Masahito ^a,b  

^a JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

^b TOHOKU UNIVERSITY   (Japan)

Author keywords

Fixed length source coding; Information spectrum; Intrinsic randomness; Second order asymptotics; Source coding folklore

Indexed keywords

EID: 54749144274     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2008.928985     Document Type: Article

References (20)

1. T.-S. Han, "Information-spectrum approaches: Tutorial," IEICE Tech. Rep., vol. IT 2003-54, pp. 31-39, 2003.
2. I. Kontoyiannis, "Second-order noiseless source coding theorems," IEEE Trans. Inf. Theory, vol. 43, no. 4, pp. 1339-1341, Jul. 1997.
3. B. S. Clarke and A. R. Barron, "Jeffreys' prior is asymptotically least favorable under entropy risk," J. Statist. Plann. Inference, vol. 41, pp. 37-61, 1994.
4. P. Flajolet and W. Szpankowski, "Analytic variations on redundancy rates of renewal processes," IEEE Trans. Inf. Theory, vol. 48, no. 11, pp. 2911-2921, Nov. 2002.
5. M. Drmota and W. Szpankowski, "Precise minimax redundancy and regret," IEEE Trans. Inf. Theory, vol. 50, no. 11, pp. 2686-2707, Nov. 2004.
6. E. Figueroa and C. Houdre, "On the asymptotic redundancy of lossless block coding with two codeword lengths," IEEE Trans. Inf. Theory, vol. 51, no. 2, pp. 688-692, Feb. 2005.
7. T.-S. Han, Information-Spectrum Methods in Information Theory. Berlin, Germany: Springer-Verlag, 2003, (originally published by Baifukan 1998 in Japanese).
8. T.-S. Han, "Folklore in source coding: Information-spectrum approach," IEEE Trans. Inf. Theory, vol. 51, no. 5, pp. 747-753, May 2004.
9. K. Visweswariah, S. Kulkarni, and S. Verdú, "Source codes as random number generators," IEEE Trans. Inf. Theory, vol. 44, no. 2, pp. 462-471, Mar. 1998.
10. T.-S. Han and O. Uchida, "Source code with cost as a nonuniform random number generator," IEEE Trans. Inf. Theory, vol. 46, no. 2, pp. 712-717, Mar. 2000.
11. Y. Steinberg and S. Verdú, "Simulation of random processes and rate-distortion theory," IEEE Trans. Inf. Theory, vol. 42, no. 1, pp. 63-86, Jan. 1996.
12. P.-N. Chen and F. Alajaji, "Optimistic shannon coding theorems for arbitrary single-user systems," IEEE Trans. Inf. Theory, vol. 45, no. 7, pp. 2623-2629, Nov. 1999.
13. H. Nagaoka and M. Hayashi, "An information-spectrum approach to classical and quantum hypothesis testing," IEEE Trans. Inf. Theory vol. 53, no. 2, pp. 534-549, Feb. 2007.
14. S. Vembu and S. Verdú, "Generating random bits from an arbitrary source: Fundamental limits," IEEE Trans. Inf. Theory, vol. 41, no. 5, pp.1322-1332, Sep. 1995.
15. M. Hayashi, "General formulas for fixed-length quantum entanglement concentration," IEEE Trans. Inf. Theory, vol. 52, no. 5, pp. 1904-1921, May 2006.
16. A. Dembo and O. Zeitouni, Large Deviation Techniques and Applications New York: Springer-Verlag, 1997.
17. Csiszár and J. Körner, Information Theory: Coding Theorems for Discrete Memoryless Systems. New York: Academic, 1981.
18. Y. Oohama and H. Sugano, "Adaptive random number generation using arithmetic coding and its performance analysis," (in Japanese) IEICE Tech. Rep., vol. IT 98-60, pp. 31-36, 1999.
19. M. Fannes, "A continuity property of the entropy density for spin lattice systems," Commun. Math. Phys., vol. 31, pp. 291-294, 1973.
20. M. Hayashi, "Information spectrum approach to second-order coding rate in channel coding," arXiv:0801.2242.