A coding theorem for a class of stationary channels with feedback

IEEE Transactions on Information Theory

Volumn 54, Issue 4, 2008, Pages 1488-1499

  Kim, Young Han ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Capacity; Channels with memory; Coding theorem; Directed information; Ergodic decomposition; Feedback; Feedback capacity; Shannon strategy

Indexed keywords

CODES (SYMBOLS); FEEDBACK; INFORMATION THEORY; SPURIOUS SIGNAL NOISE;

CODING THEOREM; DIRECTED INFORMATION; ERGODIC DECOMPOSITION; FEEDBACK CAPACITY; SHANNON STRATEGY; STATIONARY CHANNELS;

CHANNEL CODING;

EID: 42049110577     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2008.917685     Document Type: Article

References (42)

1. F. Alajaji, "Feedback does not increase the capacity of discrete channels with additive noise," IEEE Trans. Inf. Theory, vol. 41, no. 2, pp. 546-549, Mar. 1995.
2. T. Berger, Rate Distortion Theory. Englewood Cliffs, NJ: Prentice-Hall, 1971.
3. D. Blackwell, "Information theory," in Modern Mathematics for the Engineer: Second Series., New York, 1961, pp. 182-193.
4. J. R. Brown, Ergodic Theory and Topological Dynamics. New York: Academic, 1976.
5. G. Caire and S. Shamai, "On the capacity of some channels with channel state information," IEEE Trans. Inf. Theory, vol. 45, no. 6, pp. 2007-2019, Sep. 1999.
6. J. Chen and T. Berger, "The capacity of finite-state Markov channels with feedback," IEEE Trans. Inf. Theory, vol. 51, no. 3, pp. 780-798, Mar. 2005.
7. T. M. Cover, "An achievable rate region for the broadcast channel," IEEE Trans. Inf. Theory, vol. IT-21, no. 4, pp. 399-404, Jul. 1975.
8. T. M. Cover and S. Pombra, "Gaussian feedback capacity," IEEE Trans. Inf. Theory, vol. 35, no. 1, pp. 37-43, Jan. 1989.
9. T. M. Cover and J. A. Thomas, Elements of Information Theory, 2nd ed. New York: Wiley, 2006.
10. R. L. Dobrushin, "General formulation of Shannon's main theorem in information theory," Uspekhi Mat. Nauk, vol. 14, no. 6, pp. 3-104, 1959.
11. A. Feinstein, "On the coding theorem and its converse for finite-memory channels," Inf. Contr., vol. 2, pp. 25-44, 1959.
12. A. Feinstein, "A new basic theorem of information theory," IRE Trans. Inf. Theory, vol. IT-4, pp. 2-22, 1954.
13. G. D. Forney, Jr, Information Theory. Stanford, CA: Stanford Univ., 1972, Unpublished course notes.
14. R. G. Gallager, Information Theory and Reliable Communication. New York: Wiley, 1968.
15. R. G. Gallager, "A simple derivation of the coding theorem and some applications," IEEE Trans. Inf. Theory, vol. IT-11, no. 1, pp. 3-18, Jan. 1965.
16. R. M. Gray, Entropy and Information Theory. New York: Springer-Verlag, 1990.
17. R. M. Gray and D. S. Ornstein, "Block coding for discrete stationary d̄ -continuous noisy channels," IEEE Trans. Inf. Theory, vol. IT-25, no. 3, pp. 292-306, May 1979.
18. T. S. Han, Information-Spectrum Methods in Information Theory. New York: Springer, 2003.
19. A. I. Khinchin, Mathematical Foundations of Information Theory. New York, Dover:, 1957.
20. J. C. Kieffer, "Block coding for weakly continuous channels," IEEE Trans. Inf. Theory, vol. IT-27, no. 6, pp. 721-727, Nov. 1981.
21. J. C. Kieffer, "Feedback capacity of the first-order moving average Gaussian channel," IEEE Trans. Inf. Theory, vol. 52, no. 7, pp. 3063-3079, Jul. 2006.
22. Y.-H. Kim, "Feedback capacity of stationary Gaussian channels," Feb. 2006. [Online]. Available: http://arxiv.org/abs/cs.IT/0602091/
23. G. Kramer, "Directed information for channels with feedback," Dr. sc. thchn, Hartung-Gorre Verlag, Swiss Federal Inst. Technol. (ETH) Zurich, Konstanz, 1998.
24. G. Kramer, "Capacity results for the discrete memoryless network," IEEE Trans. Inf. Theory, vol. 49, no. 1, pp. 4-21, Jan. 2003.
25. A. Lapidoth and I. E. Telatar, "The compound channel capacity of a class of finite-state channels," IEEE Trans. Inf. Theory, vol. 44, no. 3, pp. 973-983, May 1998.
26. J. L. Massey, "Causality, feedback, and directed information," in Proc. Int. Symp. Inf. Theory Appl., Honolulu, HI, Nov. 1990, pp. 303-305.
27. J. L. Massey and P. C. Massey, "Conservation of mutual and directed information," in Proc. Int. Symp. Inf. Theory, Adelaide, Australia, Sep. 2005, pp. 157-158.
28. J. Nedoma, "Über die Ergodizität und τ-Ergodizität stationärer Wahr-scheinlichkeitsmasse," Z. Wahrscheinlichkeitstheorie und Verw. Gebiete, vol. 2, pp. 90-97, 1963.
29. D. L. Neuhoff and P. C. Shields, "Channels with almost finite memory," IEEE Trans. Inf. Theory, vol. IT-25, no. 4, pp. 440-447, Jul. 1979.
30. H. Permuter, P. Cuff, B. Van Roy, and T. Weissman, "Capacity of the trapdoor channel with feedback," 2006. [Online]. Available: http:// arxiv.org/abs/cs.IT/0610047/
31. H. Permuter, T. Weissman, and A. Goldsmith, "Finite-state channels with time-invariant deterministic feedback," 2006. [Online]. Available: http://arxiv.org/abs/cs.IT/0608070
32. K. Petersen, Ergodic Theory. Cambridge, U.K.: Cambridge Univ. Press, 1983.
33. M. S. Pinsker, Information and Information Stability of Random Variables and Processes. San Francisco, CA: Holden-Day, 1964.
34. C. E. Shannon, "A mathematical theory of communication," Bell Syst. Tech. J., vol. 27, pp. 379-423, 1948.
35. C. E. Shannon, "The zero error capacity of a noisy channel," IRE Trans. Inf. Theory, vol. IT-2, no. 3, pp. 8-19, Sep. 1956.
36. C. E. Shannon, "Channels with side information at the transmitter," IBM J. Res. Develop., vol. 2, pp. 289-293, 1958.
37. S. Tatikonda, "Control under communication constraints," Ph.D., Mass. Inst. Technol., Cambridge, 2000.
38. S. Tatikonda and S. Mitter, "The capacity of channels with feedback," 2006. [Online]. Available: http://arxiv.org/abs/cs.IT/0609139/
39. S. Verdú and T. S. Han, "A general formula for channel capacity," IEEE Trans. Inf. Theory, vol. 40, no. 4, pp. 1147-1157, Jul. 1994.
40. F. M. J. Willems and E. C. van der Meulen, "The discrete memory-less multiple-access channel with cribbing encoders," IEEE Trans. Inf. Theory, vol. IT-31, no. 3, pp. 313-327, 1985.
41. J. Wolfowitz, Coding Theorems of Information Theory, 3rd ed. Berlin, Germany: Springer-Verlag, 1978.
42. S. Yang, A. Kavčić, and S. Tatikonda, "Feedback capacity of finite-state machine channels," IEEE Trans. Inf. Theory, vol. 51, no. 3, pp. 799-810, Mar. 2005.