Feedback capacity of the first-order moving average Gaussian channel

IEEE Transactions on Information Theory

Volumn 52, Issue 7, 2006, Pages 3063-3079

  Kim, Yuong Han ^a  

^a Stanford University   (United States)

Author keywords

Additive Gaussian noise channels; Feedback capacity; First order moving average; Gaussian feedback capacity; Linear feedback; Schalkwijk Kailath coding scheme

Indexed keywords

COMMUNICATION CHANNELS (INFORMATION THEORY); FEEDBACK; GAUSSIAN NOISE (ELECTRONIC); LINEAR EQUATIONS; MAXIMUM LIKELIHOOD ESTIMATION; PROBABILITY; SIGNAL ENCODING; SIGNAL FILTERING AND PREDICTION;

ADDITIVE GAUSSIAN NOISE CHANNELS; FIRST-ORDER AUTOREGRESSIVE FILTER; GAUSSIAN FEEDBACK CAPACITY; LINEAR FEEDBACK; SCHALKWIJK-KAILATH CODING SCHEME;

CHANNEL CAPACITY;

EID: 33746913899     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2006.876217     Document Type: Article

References (71)

1. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
2. T. M. Cover and S. Pombra, "Gaussian feedback capacity," IEEE Trans. Inf. Theory, vol. IT-35, no. 1, pp. 37-43, Jan. 1989.
3. G. Pólya and G. Szego, Problems and Theorems in Analysis. New York: Springer-Verlag, 1998.
4. J. P. M. Schalkwijk and T. Kailath, "A coding scheme for additive noise channels with feedback-I: No bandwidth constraint," IEEE Trans. Inf. Theory, vol. IT-12, pp. 172-182, Apr. 1966.
5. J. P. M. Schalkwijk, "A coding scheme for additive noise channels with feedback-II: Band-limited signals," IEEE Trans. Inf. Theory, vol. IT-12, pp. 183-189, Apr. 1966.
6. J. Wolfowitz, "Note on the Gaussian channel with feedback and a power constraint," Inf. Contr., vol. 12, pp. 71-78, 1968.
7. C. E. Shannon, "The zero error capacity of a noisy channel," IRE Trans. Inf. Theory, vol. IT-2, no. 3, pp. 8-19, Sep. 1956.
8. T. T. Kadota, M. Zakai, and J. Ziv, "Capacity of a continuous memoryless channel with feedback," IEEE Trans. Inf. Theory, vol. IT-17, pp. 372-378, 1971.
9. T. T. Kadota, M. Zakai, and J. Ziv, "Mutual information of the white Gaussian channel with and without feedback," IEEE Trans. Inf. Theory, vol. IT-17, pp. 368-371, 1971.
10. M. S. Pinsker, "The probability of error in block transmission in a memoryless Gaussian channel with feedback," Probl. Inf. Transm., vol. 4, no. 4, pp. 3-19, 1968.
11. A. J. Kramer, "Improving communication reliability by use of an intermittent feedback channel," IEEE Trans. Inf. Theory, vol. IT-15, pp. 52-60, Jan. 1969.
12. K. S. Zigangirov, "Upper bounds for the probability of error for channels with feedback," in Probl. Inf. Transm. (Dubna, 1969), 1970, vol. 6, no. 2, pp. 87-92.
13. J. P. M. Schalkwijk, "Center-of-gravity information feedback," IEEE Trans. Inf. Theory, vol. IT-14, pp. 324-331, 1968.
14. S. Butman, "A general formulation of linear feedback communication systems with solutions," IEEE Trans. Inf. Theory, vol. IT-15, no. 3, pp. 392-400, May 1969.
15. J. Wolfowitz, "Signalling over a Gaussian channel with feedback and autoregressive note," J. Appl. Probab., vol. 12, no. 4, pp. 713-723, 1975.
16. J. C. Tiernan, "Analysis of the optimum linear system for the autoregressive forward channel with noiseless feedback," IEEE Trans. Inf. Theory, vol. IT-22, pp. 359-363, May 1976.
17. J. C. Tiernan and J. P. M. Schalkwijk, "An upper bound to the capacity of the band-limited Gaussian autoregressive channel with noiseless feedback," IEEE Trans. Inf. Theory, vol. IT-20, pp. 311-316, 1974.
18. S. Butman, "Linear feedback rate bounds for regressive channels," IEEE Trans. Inf. Theory, vol. IT-22, no. 3, pp. 363-366, May 1976.
19. L. H. Ozarow, "Random coding for additive Gaussian channels with feedback," IEEE Trans. Inf. Theory, vol. IT-36, no. 1, pp. 17-22, 1990.
20. L. H. Ozarow, "Upper bounds on the capacity of Gaussian channels with feedback," IEEE Trans. Inf. Theory, vol. IT-36, no. 1, pp. 156-161, 1990.
21. E. Ordentlich, "A class of optimal coding schemes for moving average additive Gaussian noise channels with feedback," in Proc. IEEE Int. Symp. Inf. Theory, Trondheim, Norway, Jun./Jul. 1994, p. 467.
22. S. Yang, A. Kavčic, and S. Tatikonda, "Linear Gaussian channels: Feedback capacity under power constraints," in Proc. IEEE Int. Symp. Inf. Theory, Chicago, IL, Jun./Jul. 2004, p. 72.
23. S. Yang, "The Capacity of Communication Channels With Memory," Ph.D. dissertation, Harvard University, Cambridge, MA, Jun. 2004.
24. P. Elias, "Channel Capacity Without Coding," MIT Res. Lab. Electronics, Cambridge, MA, Oct. 1956, Quarterly Progr. Rep.
25. P. E. Green, Jr., "Feedback communication systems," in Lectures on Communication System Theory (with an appendix by P. Elias, "Channel capacity without coding," pp. 363-368), E. Baghdady, Ed. New York: McGraw-Hill, 1961, pp. 345-368.
26. P. Elias, "Networks of Gaussian channels with applications to feedback systems," IEEE Trans. Inf. Theory, vol. IT-13, pp. 493-501, 1967.
27. G. L. Turin, "Signal design for sequential detection systems with feedback," IEEE Trans. Inf. Theory, vol. IT-11, pp. 401-408, 1965.
28. G. L. Turin, "Comparison of sequential and nonsequential detection systems with uncertainty feedback," IEEE Trans. Inf. Theory, vol. IT-12, pp. 5-8, 1966.
29. G. L. Turin, "More on uncertainty feedback: The bandlimited case," IEEE Trans. Inf. Theory, vol. IT-14, pp. 321-324, 1968.
30. M. Horstein, "On the design of signals for sequential and nonsequential detection systems with feedback," IEEE Trans. Inf. Theory, vol. IT-12, pp. 448-455, 1966.
31. R. Z. Khas'minskii, "Sequential signal transmission in a Gaussian channel with feedback," Probl. Inf. Transm., vol. 3, no. 2, pp. 37-44, 1967.
32. M. J. Ferguson, "Optimal signal design for sequential signaling over a channel with feedback," IEEE Trans. Inf. Theory, vol. IT-14, pp. 331-340, 1968.
33. J. K. Omura, "Optimum linear transmission of analog data for channels with feedback," IEEE Trans. Inf. Theory, vol. IT-14, pp. 38-43, 1968.
34. A. D. Wyner, "On the Schalkwijk-Kailath coding scheme with a peak energy constraint," IEEE Trans. Inf. Theory, vol. IT-14, pp. 129-134, Jan. 1968.
35. J. P. M. Schalkwijk and M. E. Barron, "Sequential signalling under a peak power constraint," IEEE Trans. Inf. Theory, vol. IT-17, pp. 278-282, May 1971.
36. R. L. Kashyap, "Feedback coding schemes for an additive noise channel with a noisy feedback link," IEEE Trans. Inf. Theory, vol. IT-14, no. 3, pp. 1355-1387, 1968.
37. S. S. Lavenberg, "Feedback communication using orthogonal signals," IEEE Trans. Inf. Theory, vol. IT-15, pp. 478-483, 1969.
38. S. S. Lavenberg, "Repetitive signaling using a noisy feedback channel," IEEE Trans. Inf. Theory, vol. IT-17, no. 3, pp. 269-278, May 1971.
39. T. Kailath, "An application of Shannon's rate-distortion theory to analog communication over feedback channels," in Proc. Princeton Symp. Syst. Sci., Princeton, NJ, Mar. 1967.
40. T. J. Cruise, "Achievement of rate-distortion bound over additive white noise channel utilizing a noiseless feedback channel," Proc. IEEE, vol. 55, no. 4, pp. 583-584, 1967.
41. J. P. M. Schalkwijk and L. I. Bluestein, "Transmission of analog waveforms through channels with feedback," IEEE Trans. Inf. Theory, vol. IT-13, no. 4, pp. 617-619, 1967.
42. I. A. Ovseevič, "Optimal transmission of Gaussian data over a channel with white Gaussian noise in the presence of an inverse connection," Probl. Inf. Transm., vol. 6, no. 3, pp. 3-14, 1970.
43. S. Ihara, "Optimal coding in white Gaussian channel with feedback," in Proceedings of the Second Japan-USSR Symposium on Probability Theory, ser. Lecture Notes in Math. Berlin, Germany: Springer-Verlag, 1973, vol. 330, pp. 120-123.
44. L. H. Ozarow and S. K. Leung-Yan-Cheong, "An achievable region and outer bound for the Gaussian broadcast channel with feedback," IEEE Trans. Inf. Theory, vol. IT-30, no. 4, pp. 667-671, 1984.
45. A. El Gamal, "The feedback capacity of degraded broadcast channels," IEEE Trans. Inf. Theory, vol. IT-24, no. 3, pp. 379-381, 1978.
46. L. H. Ozarow, "The capacity of the white Gaussian multiple access channel with feedback," IEEE Trans. Inf. Theory, vol. IT-30, no. 4, pp. 623-629, 1984.
47. G. Kramer, "Feedback strategies for white Gaussian interference networks," IEEE Trans. Inf. Theory, vol. 48, no. 6, pp. 1423-1438, 2002.
48. A. Dembo, "On Gaussian feedback capacity," IEEE Trans. Inf. Theory, vol. IT-35, no. 5, pp. 1072-1076, Sep. 1989.
49. M. S. Pinsker, Talk Delivered at the Soviet Inf. Theory Meeting. 1969, no abstract published.
50. P. M. Ebert, "The capacity of the Gaussian channel with feedback," Bell Syst. Tech. J., vol. 49, pp. 1705-1712, 1970.
51. K. Yanagi, "An upper bound to the capacity of discrete time Gaussian channel with feedback-II," IEEE Trans. Inf. Theory, vol. IT-40, pp. 588-593, Mar. 1994.
52. H. W. Chen and K. Yanagi, "Refinements of the half-bit and factor-of-two bounds for capacity in Gaussian channel with feedback," IEEE Trans. Inf. Theory, vol. IT-45, no. 1, pp. 319-325, Jan. 1999.
53. H. W. Chen and K. Yanagi, "Upper bounds on the capacity of discrete-time blockwise white Gaussian channels with feedback," IEEE Trans. Inf. Theory, vol. IT-46, no. 3, pp. 1125-1131, May 2000.
54. T. M. Cover, "Conjecture: Feedback doesn't help much," in Open Problems in Communication and Computation, T. M. Cover and B. Gopinath, Eds. New York: Springer-Verlag, 1987, pp. 70-71.
55. J. A. Thomas, "Feedback can at most double Gaussian multiple access channel capacity," IEEE Trans. Inf. Theory, vol. IT-33, no. 5, pp. 711-716, Sep. 1987.
56. S. Pombra and T. M. Cover, "Non white Gaussian multiple access channels with feedback," IEEE Trans. Inf. Theory, vol. IT-40, no. 3, pp. 885-892, May 1994.
57. E. Ordentlich, "On the factor-of-two bound for Gaussian multiple access channel with feedback," IEEE Trans. Inf. Theory, vol. IT-42, no. 6, pp. 2231-2235, Nov. 1996.
58. S. Ihara, "On the capacity of the continuous time Gaussian channel with feedback," J. Multivariate Anal., vol. 10, no. 3, pp. 319-331, 1980.
59. S. Ihara, "Capacity of mismatched Gaussian channels with and without feedback," Probab. Theory Rel. Fields, vol. 84, pp. 453-471, 1990.
60. S. Ihara, "Coding theorems for a continuous-time Gaussian channel with feedback," IEEE Trans. Inf. Theory, vol. IT-40, pp. 2041-2045, 1994.
61. S. Ihara, "Capacity of discrete time Gaussian channel with and without feedback-I," Mem. Fac. Sci. Kochi Univ. Ser. A Math., vol. 9, pp. 21-36, 1988.
62. S. Ihara, Information Theory for Continuous Systems. River Edge, NJ: World Scientific, 1993.
63. Y.-H. Kim, "Feedback capacity of stationary Gaussian channels," IEEE Trans. Inf. Theory, arXiv e-print: Cs.IT/060291, submitted for publication.
64. Y.-H. Kim, "Gaussian Feedback Capacity," Ph.D. dissertation, Stanford University, Stanford, CA, Jun. 2006.
65. W. Rudin, Real and Complex Analysis. New York: McGraw-Hill, 1987.
66. S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge, U.K.: Cambridge University Press, 2004.
67. S. Ihara, "On the capacity of the discrete time Gaussian channel with feedback," in Transactions of the Eighth Prague Conferenre on Information Theory, Statistical Decision Functions, and Random Processes. Dordrecht, Germany: Reidel, 1979, vol. C, pp. 175-186.
68. T. Kailath, A. H. Sayed, and B. Hassibi, Linear Estimation. Englewood Cliffs, NJ: Prentice-Hall, 2000.
69. D. G. Luenberger, Optimization by Vector Space Methods. New York: Wiley, 1969.
70. K. Yanagi, H. W. Chen, and J. W. Yu, "Operator inequality and its application to capacity of Gaussian channel," Taiwanese J. Math., vol. 4, no. 3, pp. 407-416, Sep. 2000.
71. A. N. Kolmogorov and S. V. Fomin, Elements of the Theory of Functions and Functional Analysis. Rochester, NY: Graylock Press, 1957.