The necessity and sufficiency of anytime capacity for stabilization of a linear system over a noisy communication link - Part I: Scalar systems

IEEE Transactions on Information Theory

Volumn 52, Issue 8, 2006, Pages 3369-3395

  Sahai, Anant ^a   Mitter, Sanjoy ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b USA   (United States)

Author keywords

Anytime decoding; Control over noisy channels; Error exponents; Feedback; Real time information theory; Reliability functions; Sequential coding

Indexed keywords

CHANNEL CAPACITY; COMMUNICATION CHANNELS (INFORMATION THEORY); DECODING; DELAY CONTROL SYSTEMS; FEEDBACK CONTROL; GAUSSIAN NOISE (ELECTRONIC); LINEAR SYSTEMS; SIGNAL ENCODING; WHITE NOISE;

ANYTIME DECODING; ERROR EXPONENTS; NOISY COMMUNICATION LINK; REAL-TIME INFORMATION THEORY; RELIABILITY FUNCTIONS; SEQUENIAL CODING;

TELECOMMUNICATION LINKS;

EID: 33746602323     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2006.878169     Document Type: Review

References (51)

1. R. G. Gallager, Information Theory and Reliable Communication. New York: Wiley, 1971.
2. S. Vembu, S. Verdu, and Y. Steinberg, "The source-channel separation theorem revisited," IEEE Trans. Inf. Theory, vol. 41, no. 1, pp. 44-54, Jan. 1995.
3. L. J. Schulman, "Coding for interactive communication," IEEE Trans. Inf. Theory, vol. 42, no. 6, pp. 1745-1756, Nov. 1996.
4. S. Rajagopalan, "A Coding Theorem for Distributed Computation," Ph.D. dissertation, University of California, Berkeley, 1994.
5. C. E. Shannon, "Coding theorems for a discrete source with a fidelity criterion," IRE Nat. Conv. Rec., vol. 7, no. 4, pp. 142-163, 1959.
6. A. Sahai, "Why block length and delay are not the same thing," IEEE Trans. Inf. Theory To be submitted, [Online]. Available: [Online]. Available: http://www.eecs.berkeley.edu/~sahai/Papers/Focusing-Bound.pdf
7. Y. C. Ho, M. P. Kastner, and E. Wong, "Teams, signaling, and information theory," IEEE Trans. Automat. Contr., vol. 23, no. 2, pp. 305-312, Apr. 1978.
8. S. Tatikonda, "Control under communication constraints," Ph.D. dissertation, Massachusetts Institute of Technology, Cambridge, MA, 2000.
9. S. Tatikonda and S. K. Mitter, "Control under communication constraints," IEEE Trans. Automat. Contr., vol. 49, no. 7, pp. 1056-1068, July 2004.
10. G. N. Nair and R. J. Evans, "Communication-limited stabilization of linear systems," in Proc. 39th IEEE Conf. Decision Contr., Sydney, Australia, Dec. 2000, pp. 1005-1010.
11. G. N. Nair and R. J. Evans, "Stabilizability of stochastic linear systems with finite feedback data rates," SIAM J. Contr. Optim., vol. 43, no. 2, pp. 413-436, Jul. 2004.
12. S. Tatikonda and S. K. Mitter, "Control over noisy channels," IEEE Trans. Automat. Contr., vol. 49, no. 7, pp. 1196-1201, Jul. 2004.
13. A. Sahai, S. Tatikonda, and S. K. Mitter, "Control of LQG systems under communication constraints," in Proc. 1999 Amer. Contr. Conf., San Diego, CA, Jun. 1999, pp. 2778-2782.
14. S. Tatikonda, A. Sahai, and S. K. Mitter, "Stochastic linear control over a communication channel," IEEE Trans. Automat. Contr., vol. 49, no. 9, pp. 1549-1561, Sep. 2004.
15. R. Bansal and T. Basar, "Simultaneous design of measurement and control strategies for stochastic systems with feedback," Automatica, vol. 45, no. 5, pp. 679-694, Sep. 1999.
16. A. Sahai, "Evaluating channels for control: Capacity reconsidered," in Proc. 2000 Amer. Contr. Conf., Chicago, IL, Jun. 2000, pp. 2358-2362.
17. N. C. Martins, N. Elia, and M. A. Dahleh, "Stabilization of uncertain systems in the presence of a stochastic digital link," IEEE Trans. Automat. Contr., submitted for publication.
18. N. Elia, "When Bode meets Shannon: Control-oriented feedback communication schemes," IEEE Trans. Automat. Contr., vol. 49, no. 9, pp. 1477-1488, Sep. 2004.
19. N. Elia, "Remote stabilization over fading channels," Syst. Contr. Lett., vol. 54, no. 3, pp. 239-249, Mar. 2005.
20. S. Yuksel and T. Basar, "Achievable rates for stability of LTI systems over noisy forward and feedback channels," in Proc. 2005 Conf. Inf. Sci. Syst., Baltimore, MD, Mar. 2005, paper 12.
21. R. Gray, "Information rates of autoregressive processes," IEEE Trans. Inf. Theory, vol. 16, no. 4, pp. 412-421, Jul. 1970.
22. T. Berger, "Information rates of Wiener processes," IEEE Trans. Inf. Theory, vol. 16, no. 2, pp. 134-139, Mar. 1970.
23. A. Sahai and S. K. Mitter, "Source coding and channel requirements for unstable processes," IEEE Trans. Inf. Theory to be submitted, [Online]. Available: [OnlHne]. Available: http://www.eecs.berkeley.edu/ ~sahai/Papers/anytime.pdf
24. T. Berger, Rate Distortion Theory. Englewood Cliffs, NJ: Prentice-Hall, 1971.
25. C. E. Shannon, "The zero error capacity of a noisy channel," IEEE Trans. Inf. Theory, vol. 2, no. 3, pp. 8-19, Sept. 1956.
26. V. Borkar and S. K. Mitter, "LQG control with communication constraints," in Commun., Comput., Contr., Signal Process: A Tribute to Thomas Kailath. Norwell, MA: Kluwer Academic Publishers, 1997, pp. 365-373.
27. G. D. Forney, "Convolutional codes II. Maximum-likelihood decoding," Inf. Contr., vol. 25, no. 3, pp. 222-266, Jul. 1974.
28. M. V. Burnashev, "Data transmission over a discrete channel with feedback, random transmission time," Problemy Perdachi Informatsii, vol. 12, no. 4, pp. 10-30, Oct./Dec. 1976.
29. R. L. Dobrushin, "An asymptotic bound for the probability error of information transmission through a channel without memory using the feedback," Problemy Kibernetiki, vol. 8, pp. 161-168, 1962.
30. A. Sahai and Q. Xu, "The anytime reliability of constrained packet erasure channels with feedback," in Proc. 42nd Allerton Conf. Commun., Contr., Comput., Monticello, IL, Sept. 2004, pp. 200-209.
31. B. Sinopoli, L. Schenato, M. Franceschetti, K. Poolla, M. Jordan, and S. Sastry, "Kalman filtering with intermittent observations," IEEE Trans. Automat. Contr., vol. 49, no. 9, pp. 1453-1464, Sept. 2004.
32. X. Liu and A. J. Goldsmith, "Kalman filtering with partial observation losses," IEEE Trans. Automat. Contr. submitted for publication.
33. A. Sahai, "Any-Time Information Theory," Ph.D. dissertation, Massachusetts Institute of Technology, Cambridge, MA, 2001.
34. H. T. Simsek, "Anytime channel coding with feedback," Ph.D. dissertation, University of California, Berkeley, 2004.
35. I. M. Jacobs and E. R. Berlekamp, "A lower bound to the distribution of computation for sequential decoding," IEEE Trans. Inf. Theory, vol. 13, no. 2, pp. 167-174, Apr. 1967.
36. J. P. M. Schalkwijk and T. Kailath, "A coding scheme for additive noise channels with feedback - I: No bandwidth constraint," IEEE Trans. Inf. Theory, vol. 12, no. 2, pp. 172-182, Apr. 1966.
37. J. P. M. Schalkwijk, "A coding scheme for additive noise channels with feedback - II: Band-limited signals," IEEE Trans. Inf. Theory, vol. 12, no. 2, pp. 183-189, Apr. 1966.
38. A. J. Kramer, "Improving communication reliability by use of an intermittent feedback channel," IEEE Trans. Inf. Theory, vol. 15, no. 1, pp. 52-60, Jan. 1969.
39. A. Sahai and Q. Xu, "The anytime reliability of the AWGN+erasure channel with feedback," in Proc. 42nd Allerton Conf. Commun., Contr., Comput., Monticello, IL, Sep. 2004, pp. 300-309.
40. A. Sahai, S. Avestimehr, and P. Minero, "Anytime communication over the Gilbert-Eliot channel with noiseless feedback," in Proc. IEEE Int. Symp. Inf. Theory, Adelaide, Australia, Sept. 2005, pp. 1783-1787.
41. H. S. Witsenhausen, "Separation of estimation and control for discrete time systems," Proc. IEEE, vol. 59, no. 11, pp. 1557-1566, Nov. 1971.
42. H. S. Witsenhausen, "A counterexample in stochastic optimum control," SIAM J. Contr., vol. 6, no. 1, pp. 131-147, Jan. 1968.
43. S. K. Mitter and A. Sahai, "Information and control: Witsenhausen revisited," in Learning, Control and Hybrid Systems: Lecture Notes in Control and Information Sciences 241, Y. Yamamoto and S. Hara, Eds. New York, NY: Springer, 1999, pp. 281-293.
44. T. Cover and J. Thomas, Elements of Information Theory. New York: Wiley, 1991.
45. G. D. Forney, "Convolutional codes III. Sequential decoding," Inf. Contr., vol. 25, no. 3, pp. 267-297, Jul. 1974.
46. F. Jelinek, "Upper bounds on sequential decoding performance parameters," IEEE Trans. Inf. Theory, vol. 20, no. 2, pp. 227-239, Mar. 1974.
47. A. Sahai and H. Palaiyanur, "A simple encoding and decoding strategy for stabilization over discrete memoryless channels," in Proc. Allerton Conf. Commun., Contr., Comput., Monticello, IL, Sep. 2005 [Online]. Available: http://www.eecs.berkeley.edu/~sahai/Papers/ allerton05-sequential-stabilization.pdf
48. M. Costa, "Writing on dirty paper," IEEE Trans. Inf. Theory, vol. 29, no. 3, pp. 439-441, May 1983.
49. A. Sahai, "Anytime coding on the infinite bandwidth AWGN channel: A sequential semi-orthogonal code," in Proc. 2005 Conf. Inf. Sci. Syst., Baltimore, MD, Mar. 2005 [Online]. Available: http:// www.eecs.berkeley.edu/~sahai/Papers/ciss05wideband.pdf, paper 196
50. A. Sahai, "Stabilization over discrete memoryless and wideband channels using nearly memoryless observations," in the 44th IEEE Conf. Decision Contr., 2005 [Online]. Available: http://www.eecs. berkeley.edu/~sahai/Papers/memorylesscontrol.pdf, submitted for publication
51. J. E. Hopcroft and J. D. Ullman, Introduction to Automata Theory, Languages, and Computation. Reading, MA: Addison-Wesley, 1979.