Finite state channels with time-invariant deterministic feedback

IEEE Transactions on Information Theory

Volumn 55, Issue 2, 2009, Pages 644-662

  Permuter, Haim Henry ^a,b   Weissman, Tsachy ^a,c   Goldsmith, Andrea J ^a  

^a Stanford University   (United States)

^b BEN GURION UNIVERSITY OF THE NEGEV   (Israel)

^c TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Causal conditioning; Code tree; Directed information; Feedback capacity; Maximum likelihood; Random coding; Source channel coding separation

Indexed keywords

BLOCK CODES; CHANNEL CODING; INTERSYMBOL INTERFERENCE; MAXIMUM LIKELIHOOD; SEPARATION; WIRELESS TELECOMMUNICATION SYSTEMS;

CAUSAL CONDITIONING; CODE-TREE; DIRECTED INFORMATION; FEEDBACK CAPACITY; RANDOM CODING; SOURCE-CHANNEL CODING SEPARATION;

STATE FEEDBACK;

EID: 61349174057     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2008.2009849     Document Type: Article

References (32)

1. R. G. Gallager, Information Theory and Reliable Communication. New York: Wiley, 1968.
2. C. E. Shannon, "The zero error capacity of a noisy channel," IEEE Trans. Inf. Theory, vol. IT-2, no. 3, pp. 8-19, Sep. 1956.
3. L. Breiman, D. Blackwell, and A. J. Thomasian, "Proof of Shannon's transmission theorem for finite-state indecomposable channels," Ann. Math. Statist., vol. 29, pp. 1209-1220, 1958.
4. T. M. Cover and S. Pombra, "Gaussian feedback capacity," IEEE Trans. Inf. Theory, vol. 35, no. 1, pp. 37-43, Jan. 1989.
5. J. Massey, "Causality, feedback and directed information," in Proc. Int. Symp. Information Theory and Its Applications (ISITA-90 , Waikiki, HI, Nov. 1990, pp. 303-305.
6. H. Marko, "The bidirectional communication theory- A generalization of information theory," IEEE Trans. Commun., vol. COM-21, no. 12, pp. 1335-1351, Dec. 1973.
7. S. C. Tatikonda, "Control Under Communication Constraints," Ph.D. dissertation, MIT, Cambridge, MA, 2000.
8. S. C. Tatikonda, "A Markov decision approach to feedback channel capacity," in Proc. 44th IEEE Conf. Decision and Control, 2005 and 2005 European Control Conf., CDC-ECC, Spain, Dec. 2005, pp. 3213-3218.
9. S. Verdú and F. Han, "A general formula for channel capacity," IEEE. Trans. Inf. Theory, vol. 40, no. 4, pp. 1147-1157, Jul. 1994.
10. S. Yang, A. Kavčić, and S. Tatikonda, "Feedback capacity of finite-state machine channels," IEEE Trans. Inf. Theory, vol. 51, no. 3, pp. 799-810, Mar. 2005.
11. J. Chen and T. Berger, "The capacity of finite-state Markov channels with feedback," IEEE Trans. Inf. Theory, vol. 51, no. 3, pp. 780-789, Mar. 2005.
12. T. Weissman and N. Merhav, "On competitive prediction and its relation to rate-distortion theory," IEEE Trans. Inf. Theory, vol. 49, no. 12, pp. 3185-3194, Dec. 2003.
13. S. S. Pradhan, "Source coding with feedforward: Gaussian sources," in Proc. 2004 Int. Symp. Information Theory, Chicago, IL, Jun./Jul. 2004, p. 212.
14. R. Venkataramanan and S. S. Pradhan, "Source coding with feedforward: Rate-distortion theorems and error exponents for a general source," IEEE Trans. Inf. Theory, vol. 53, no. 6, pp. 2154-2179, Jun. 2007.
15. R. Zamir, Y. Kochman, and U. Erez, "Achieving the Gaussian rate-distortion function by prediction," IEEE Trans. Inf. Theory, submitted for publication.
16. G. Kramer, "Directed Information for Channels With Feedback," Ph.D. dissertation, Swiss Federal Institute of Technology (ETH), Zurich, Switzerland, 1998.
17. H. Viswanathan, "Capacity of Markov channels with receiver csi and delayed feedback," IEEE Trans. Inf. Theory, vol. 45, no. 2, pp. 761-771, Mar. 1999.
18. G. Caire and S. Shamai (Shitz), "On the capacity of some channels with channel state information," IEEE Trans. Inf. Theory, vol. 45, no. 6, pp. 2007-2019, Sep. 1999.
19. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
20. G. Kramer, "Capacity results for the discrete memoryless network," IEEE Trans. Inf. Theory, vol. 49, no. 1, pp. 4-21, Jan. 2003.
21. J. Massey, "Conservation of mutual and directed information," in Proc. Int. Symp. Information Theory (ISIT-05), Adelaide, Australia, Sep. 2005, pp. 157-158.
22. R. E. Blahut, Principles and Practice of Information Theory. Reading, MA: Addison-Wesley, 1987.
23. C. E. Shannon, "Two-way communication channels," in Proc. 4th Berkeley Symp. Math. Statist. and Prob., Berkeley, CA, 1961, pp. 611-614.
24. A. Lapidoth and I. E. Telatar, "The compound channel capacity of a class of finite-state channels," IEEE Trans. Inf. Theory, vol. 44, pp. 973-983, 1998.
25. F. Jelinek, "Indecomposable channels with side information at the transmitter," Inf. Contr., vol. 8, pp. 36-55, 1965.
26. R. Ash, Information Theory. New York: Wiley, 1965.
27. S. Vembu, S. Verdú, and Y. Steinberg, "The source-channel separation theorem revisited," IEEE Trans. Inf. Theory, vol. 41, no. 1, pp. 44-54, Jan. 1995.
28. T. Berger, Rate Distortion Theory: A Mathematical Basis for Data Compression. Englewood Cliffs, NJ: Prentice-Hall, 1971.
29. S. C. Tatikonda and S. Mitter, "The capacity of channels with feedback," IEEE Trans. Inf. Theory, submitted for publication.
30. Y.-H. Kim, "A coding theorem for a class of stationary channels with feedback," IEEE Trans. Inf. Theory, vol. 54, pp. 1488-1499, Apr. 2008.
31. H. H. Permuter, P. W. Cuff, B. Van-Roy, and T. Weissman, "Capacity of the trapdoor channel with feedback," in Proc. Allerton Conf. Communications, Control, and Computing, Monticello, IL, Sep. 2006, pp. 3150-3165.
32. D. Blackwell, "Information theory," in Modern Mathematics for the Engineer: Second Series. New York: McGraw-Hill, 1961, pp. 183-193.