A tight upper bound for the third-order asymptotics for most discrete memoryless channels

IEEE Transactions on Information Theory

Volumn 59, Issue 11, 2013, Pages 7041-7051

  Tomamichel, Marco ^a   Tan, Vincent Y F ^b,c  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

^c NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Channel coding converse; discrete memoryless channel; dispersion; finite blocklength; second order coding rates; third order asymptotics

Indexed keywords

AVERAGE ERROR PROBABILITY; CODING RATE; DISCRETE MEMORYLESS CHANNELS; DISPERSION CAPACITY; ERROR CAPACITY; FINITE BLOCKLENGTH; NORMAL APPROXIMATION; THIRD-ORDER ASYMPTOTICS;

CHANNEL CAPACITY; COMMUNICATION CHANNELS (INFORMATION THEORY); DISPERSION (WAVES);

DISPERSIONS;

EID: 84886705884     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2013.2276077     Document Type: Article

References (22)

1. C. E. Shannon, "A mathematical theory of communication," Bell Syst. Tech. J., vol. 27, pp. 379-423, 1948.
2. J. Wolfowitz, Coding Theorems of Information Theory, 3rd ed. New York, NY, USA: Springer-Verlag, 1978.
3. V. Strassen, "Asymptotische Abschätzungen in Shannons informationstheorie," in Trans. Third Prague Conf. Inf. Theory, Prague, 1962, pp. 689-723.
4. Y. Polyanskiy, H. V. Poor, and S. Verdú, "Channel coding in the finite blocklength regime," IEEE Trans. Inf. Theory, vol. 56, pp. 2307-59, May 2010.
5. Y. Polyanskiy, "Channel Coding: Non-Asymptotic Fundamental Limits," Ph.D. dissertation, Princeton Univ., Princeton, NJ, USA, 2010.
6. M. Hayashi, "Information spectrum approach to second-order coding rate in channel coding," IEEE Trans. Inf. Theory, vol. 55, no. 11, pp. 4947-66, Nov. 2009.
7. P.Moulin, "The log-volume of optimal constant-composition codes for memoryless channels, within bits," presented at the Int. Symp. Inf. Theory, Cambridge, MA, USA, 2012.
8. N. R. Chaganty and J. Sethuraman, "Strong large deviation and local limit theorems," Ann. Prob., vol. 21, no. 3, pp. 1671-90, 1993.
9. R. Bahadur and R. Ranga, "On deviations of the sample mean," Ann. Math. Statist., vol. 31, pp. 1015-27, 1960.
10. P. Moulin, "The log-volume of optimal codes for memoryless channels, up to a few nats," presented at the Inf. Theory Appl. Workshop, San Diego, CA, USA, 2012.
11. I. Csiszár and J. Körner, Information Theory: Coding Theorems for Discrete Memoryless Systems. Cambridge, U.K.: Cambridge Univ. Press, 2011.
12. T. S. Han, Information-Spectrum Methods in Information Theory. Berlin, Germany: Springer-Verlag, 2003.
13. R. G. Gallager, Information Theory and Reliable Communication. New York, NY, USA: Wiley, 1968.
14. L.Wang, R. Colbeck, and R. Renner, "Simple channel coding bounds," presented at the Int. Symp. Inf. Theory, Seoul, Korea, 2009.
15. L.Wang and R. Renner, "One-shot classical-quantum capacity and hypothesis testing," Phys. Rev. Lett., vol. 108, p. 200501, May 2012.
16. M. Tomamichel and M. Hayashi, "A hierarchy of information quantities for finite block length analysis of quantum tasks," IEEE Trans. Inf. Theory [Online]. Available: arXiv:1208.1478, accepted for publication
17. F. Dupuis, L.Krämer, P. Faist, J. M. Renes, and R. Renner, Generalized entropies 2012 [Online]. Available: arXiv:1211.3141
18. Juschkewtisch, "Über einen Grenzwertsatz, der mit dem Begriff der Entropie einer Markoffschen Kette zusammenhängt," Uspechi Mat. Nauk VIII, vol. 5, 1953.
19. W. Feller, An Introduction to Probability Theory and Its Applications, 2nd ed. New York, NY, USA: Wiley, 1971.
20. Y. Polyanskiy, "Saddle point in the minimax converse for channel coding," IEEE Trans. Inf. Theory, vol. 59, no. 5, pp. 2576-95, May 2013.
21. I. Csiszár and Z. Talata, "Context tree estimation for not necessarily finite memory processes, via BIC and MDL," IEEE Trans. Inf. Theory, vol. 52, no. 3, pp. 1007-16, Mar. 2006. (Pubitemid 46444888)
22. A. Ingber, R. Zamir, and M. Feder, "Finite-dimensional infinite constellations," IEEE Trans. Inf. Theory, vol. 59, no. 3, pp. 1630-56, Mar. 2013.