On computing the feedback capacity of channels and the feed-forward rate-distortion function of sources

IEEE Transactions on Communications

Volumn 58, Issue 7, 2010, Pages 1889-1896

  Venkataramanan, Ramji ^a   Pradhan, S Sandeep ^b  

^a STANFORD UNIVERSITY   (United States)

^b University of Michigan   (United States)

Author keywords

computation; Feed forward; feedback

Indexed keywords

COMPUTATION; DISTORTION FUNCTIONS; FEED-FORWARD; FEEDBACK CAPACITY; JOINT DISTRIBUTIONS; OPTIMAL FEEDBACK; PERFORMANCE LIMITS; RATE-DISTORTION FUNCTION; SUFFICIENT CONDITIONS;

COST FUNCTIONS; OPTIMIZATION; SIGNAL DISTORTION;

ELECTRIC DISTORTION;

EID: 77954833975     PISSN: 00906778     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCOMM.2010.07.090115     Document Type: Article

References (21)

1. C. E. Shannon, "The zero-error capacity of a noisy channel," IRE Trans. Inf. Theory, vol.IT-2, pp. 8-19, 1956.
2. H. Marko, "The bidirectional communication theory-a generalization of information theory," IEEE Trans. Commun., vol.COM-21, pp. 1345- 1351, Dec. 1973.
3. J. Massey, "Causality, feedback and directed information," in Proc. 1990 Symp. Inf. Theory Appl. (ISITA-90), pp. 303-305, 1990.
4. S. Tatikonda, "Control under communications constraints," Ph.D. thesis, Massachusetts Institute of Technology, Cambridge, MA, Sep. 2000.
5. S. Tatikonda and S. Mitter, "The capacity of channels with feedback," IEEE Trans. Inf. Theory, vol.55, pp. 323-349, Jan. 2009.
6. G. Kramer, "Capacity results for the discrete memoryless network," IEEE Trans. Inf. Theory, vol.49, pp. 4-20, Jan. 2003.
7. T. M. Cover and S. Pombra, "Gaussian feedback capacity," IEEE Trans. Inf. Theory, vol.IT-35, pp. 37-43, Jan. 1989.
8. Y. H. Kim, "The feedback capacity of the first-order moving average Gaussian channel," IEEE Trans. Inf. Theory, vol.IT-52, pp. 3063-3079, July 2006.
9. Y. H. Kim, "A coding theorem for a class of stationary channels with feedback," IEEE Trans. Inf. Theory, vol.IT-25, pp. 1488-1499, Apr. 2008.
10. T. Weissman and N. Merhav, "On competitive prediction and its relation to rate-distortion theory," IEEE Trans. Inf. Theory, vol.IT-49, pp. 3185- 3194, Dec. 2003.
11. S. S. Pradhan, "On the role of feedforward in Gaussian sources: pointto- point source coding and multiple description source coding," IEEE Trans. Inf. Theory, vol.53, pp. 331-349, Jan. 2007.
12. E. Martinian and G. W. Wornell, "Source coding with fixed lag side inf," in Proc. 42nd Annual Allerton Conf., Monticello, IL, 2004.
13. R. Venkataramanan and S. S. Pradhan, "Source coding with feedforward: rate-distortion theorems and error exponents for a general source," IEEE Trans. Inf. Theory, vol.53, no.6, pp. 2154-2179, 2007.
14. R. E. Blahut, "Computation of channel capacity and rate-distortion function," IEEE Trans. Inf. Theory, vol.18, pp. 460-473, July 1972.
15. I. Csiszár and J. Körner, Information Theory: Coding Theorems for Discrete Memoryless Systems. New York: Academic Press, 1981.
16. M. Gastpar, B. Rimoldi, and M. Vetterli, "To code, or not to code: lossy source-channel communication revisited," IEEE Trans. Inf. Theory, vol.49, no.5, pp. 1147-1158, 2003.
17. S. S. Pradhan, J. Chou, and K. Ramchandran, "Duality between source coding and channel coding and its extension to the side-information case," IEEE Trans. Inf. Theory, vol.49, pp. 1181-1203, May 2003.
18. T. S. Han, Information-Spectrum Methods in Information Theory. Springer, 2002.
19. M. S. Pinsker, Information and Information Stability of Random Variables and Processes. San Francisco, CA: Holden-Day, 1964 (translated by A. Feinstein).
20. R. Venkataramanan, "Information-theoretic results on communication problems with feed-forward and feedback," Ph.D. thesis, University of Michigan, 2008.
21. S. Verdú and T. Han, "A general formula for channel capacity," IEEE Trans. Inf. Theory, vol.40, pp. 1147-1157, July 1994.