Optimal feedback communication via posterior matching

IEEE Transactions on Information Theory

Volumn 57, Issue 3, 2011, Pages 1186-1222

  Shayevitz, Ofer ^a   Feder, Meir ^b  

^a University of California at San Diego   (United States)

^b TEL AVIV UNIVERSITY   (Israel)

Author keywords

Channel capacity; feedback communication; Horstein scheme; iterated function system; Schalkwijk Kailath scheme

Indexed keywords

ACHIEVABLE RATE; AWGN CHANNEL; CHANNEL MODEL; CLOSED-FORM EXPRESSION; ERROR PROBABILITIES; FEEDBACK COMMUNICATION; FEEDBACK TRANSMISSION; FUNDAMENTAL PRINCIPLES; HORSTEIN SCHEME; ILLUSTRATIVE EXAMPLES; INFORMATION RATES; ITERATED FUNCTION SYSTEM; LARGE CLASS; MATCHING SCHEME; MEMORYLESS CHANNELS; MUTUAL INFORMATIONS; NOISELESS FEEDBACK; OPTIMAL COMMUNICATION; OPTIMAL FEEDBACK; SCHALKWIJK-KAILATH SCHEME; UNIFIED FRAMEWORK;

CHANNEL CAPACITY; OPTIMIZATION; PROBABILITY; TRANSMISSIONS;

COMMUNICATION;

EID: 79951941051     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2011.2104992     Document Type: Article

References (37)

1. C. E. Shannon, "The zero-error capacity of a noisy channel," IRE Trans. Inf. Theory, vol. IT-2, pp. 8-19, Sep. 1956.
2. T. T. Kadota, M. Zakai, and J. Ziv, "Capacity of a continuous memoryless channel with feedback," IEEE Trans. Inf. Theory, vol. IT-17, pp. 372-378, Jul. 1971.
3. M. Horstein, "Sequential transmission using noiseless feedback," IEEE Trans. Inf. Theory, vol. IT-9, pp. 136-143, Jul. 1963.
4. J. P. M. Schalkwijk, "A class of simple and optimal strategies for block coding on the binary symmetric channel with noiseless feedback," IEEE Trans. Inf. Theory, vol. IT-17, no. 3, pp. 283-287, May 1971.
5. J. P. M. Schalkwijk and K. A. Post, "On the error probability for a class of binary recursive feedback strategies," IEEE Trans. Inf. Theory, vol. IT-19, pp. 498-511, Jul. 1973.
6. M. Horstein, Sequential Transmission of Digital Information With Feedback Research Laboratory of Electronics, Cambridge, MA, Tech. Rep. 375, 1960, MIT.
7. J. P. M. Schalkwijk and T. Kailath, "A coding scheme for additive noise channels with feedback part I: No bandwidth constraint," IEEE Trans. Inf. Theory, vol. IT-12, pp. 172-182, Apr. 1966.
8. J. P. M. Schalkwijk, "A coding scheme for additive noise channels with feedback part II: Band-limited signals," IEEE Trans. Inf. Theory, vol. IT-12, pp. 183-189, Apr. 1966.
9. Y. H. Kim, A. Lapidoth, and T.Weissman, "On reliability of Gaussian channels with noisy feedback," in Proc. 44th Allerton Conf. Communication, Control, and Computing, Sep. 2006.
10. A. Sahai and S. Mitter, "The necessity and sufficiency of anytime capacity for stabilization of a linear system over a noisy communication link-Part I: Scalar systems," IEEE Trans. on Inf. Theory, vol. 52, no. 8, pp. 3369-3395, Aug. 2006. (Pubitemid 44145106)
11. R. Gallager, Information Theory and Reliable Communication. New York: Wiley, 1968.
12. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
13. S. P. Meyn and R. L. Tweedie, Markov Chains and Stochastic Stability. Berlin/New York: Springer-Verlag, 1993.
14. O. Hernández-Lerma and J. B. Lasserre, Markov Chains and Invariant Probabilities. Berlin: Birkhäuser Verlag, 2003.
15. Y. Kifer, Ergodic Theory of Random Transformations. Boston, MA: Birkhäuser, 1986.
16. P. Diaconis and D. Freedman, "Iterated random functions," SIAM Rev., vol. 41, no. 1, pp. 45-76, 1999. (Pubitemid 129723747)
17. D. Steinsaltz, "Locally contractive iterated function systems," Ann. of Prob., vol. 27, no. 4, pp. 1952-1979, Oct. 1999.
18. Ö. Stenflo, "Ergodic theorems for markov chains represented by iterated function systems," Bull. Polish Acad. Sci. Math., vol. 49, no. 1, pp. 27-43, 2001.
19. S. Verdú, "The exponential distribution in information theory," Prob. Inform. Transmiss., vol. 32, no. 1, pp. 86-95, Jan.-Mar. 1996.
20. A. N. Kolmogorov and S. V. Fomin, Introductory Real Anal.. New York: Dover Publications, 1975.
21. A. Kramer, "Improving communication reliability by use of an intermittent feedback channel," IEEE Trans. Inf. Theory, vol. IT-15, no. 1, pp. 52-60, Jan. 1969.
22. R. G. Gallager and B. Nakiboglu, "Variations on a theme by Schalkwijk and Kailath," IEEE Trans. Inf. Theory, vol. 56, no. 1, pp. 6-17, Jan. 2010.
23. T. Weissman, "Robustness and sensitivity of the Schalkwijk-Kailath scheme," The Kailath Colloq., 2006.
24. R. Zamir and U. Erez, "A Gaussian input is not too bad," IEEE Trans. Inf. Theory, vol. 50, no. 6, pp. 1362-1367, Jun. 2004.
25. J. M. Ooi and G. W.Wornell, "Fast iterative coding techniques for feedback channels," IEEE Trans. Inf. Theory, vol. IT-44, pp. 2960-2976, Nov. 1998. (Pubitemid 128739998)
26. A. Tchamkerten and I. E. Telatar, "Variable length coding over unknown channels," IEEE Trans. Inf. Theory, vol. 52, no. 5, pp. 2126-2145, May 2006.
27. M. Feder and A. Lapidoth, "Universal decoding for channels with memory," IEEE Trans. Inf. Theory, vol. 44, no. 5, pp. 1726-1745, Sep. 1998. (Pubitemid 128738547)
28. O. Shayevitz and M. Feder, "Achieving the empirical capacity using feedback: Memoryless additive models," IEEE Trans. Inf. Theory, vol. 55, no. 3, pp. 1269-1295, Mar. 2009.
29. O. Shayevitz and M. Feder, "Communication with feedback via posterior matching," in Proc. Int. Symp. Information Theory, Jun. 2007.
30. O. Shayevitz and M. Feder, "The posterior matching feedback scheme: Capacity achieving and error analysis," in Proc. Int. Symp. Information Theory, Jul. 2008.
31. J. Massey, "Causality, feedback and directed information," in Proc. Int. Symp. Information Theory and Its Applications, 1990.
32. S. C. Tatikonda, "Control Under Communication Constraints," doctoral dissertation, , Sep. 2000, MIT.
33. Y. H. Kim, "A coding theorem for a class of stationary channels with feedback," IEEE Trans. Inf. Theory, vol. 54, no. 4, pp. 1488-1499, Apr. 2008.
34. S. Tatikonda and S. Mitter, "The capacity of channels with feedback," IEEE Trans. Inf. Theory, vol. 55, no. 1, pp. 323-349, Jan. 2009.
35. H. H. Permuter, T. Weissman, and A. J. Goldsmith, "Finite state channels with time-invariant deterministic feedback," IEEE Trans. Inf. Theory, vol. 55, no. 2, pp. 644-662, Feb. 2009.
36. Y.-.H. Kim, "Feedback capacity of stationary Gaussian channels," IEEE Trans. Inf. Theory, vol. 56, no. 1, pp. 57-85, Jan. 2010.
37. P. Walters, An Introduction to Ergodic Theory. New York: Springer- Verlag, 1982.