Optimal design of sequential real-time communication systems

IEEE Transactions on Information Theory

Volumn 55, Issue 11, 2009, Pages 5317-5338

  Mahajan, Aditya ^a,b   Teneketzis, Demosthenis ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

^b Yale University   (United States)

Author keywords

Dynamic teams; Information states; Joint source channel coding; Nonclassical information structures; Real time communication; Zero delay communication

Indexed keywords

INFORMATION STATES; JOINT SOURCE-CHANNEL CODING; NONCLASSICAL INFORMATION STRUCTURES; REAL-TIME COMMUNICATION; ZERO-DELAY COMMUNICATION;

CHANNEL CODING; COMMUNICATION SYSTEMS; DECISION THEORY; DESIGN; FUNCTIONAL ANALYSIS; GAME THEORY; OPTIMAL SYSTEMS; OPTIMIZATION; STOCHASTIC CONTROL SYSTEMS;

REAL TIME SYSTEMS;

EID: 70350716504     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2009.2030462     Document Type: Article

References (61)

1. C. E. Shannon, "A mathematical theory of communication," Bell System Technical Journal, vol. 22, pp. 379-423, Jul. 1948.
2. N. T. Gaarder and D. Slepian, "On optimal finite-state digital transmission systems," in Proc. Int. Symp. Inf. Theory, Grignano, Italy, Jun. 1979.
3. N. T. Gaarder and D. Slepian, "On optimal finite-state digital transmission systems," IEEE Trans. Inf. Theory, vol. 28, pp. 167-186, 1982.
4. T. Linder and G. Lugosi, "A zero-delay sequential scheme for lossy coding of individual sequences," IEEE Trans. Inf. Theory Theory, vol. 47, pp. 2533-2538, 2001.
5. T. Weissman and N. Merhav, "On limited-delay lossy coding and filtering of individual sequences," IEEE Trans. Inf. Theory, vol. 48, pp. 721-733, 2002.
6. A. Gýorgy, T. Linder, and G. Lugosi, "Efficient adaptive algorithms and minimax bounds for zero-delay lossy source coding," IEEE Trans. Signal Processing, vol. 52, pp. 2337-2347, 2004.
7. S. Matloub and T. Weissman, "Universal zero-delay joint source-channel coding," IEEE Trans. Inf. Theory, vol. 52, pp. 5240-5250, Dec. 2006.
8. S. P. Lloyd, "Rate versus fidelity for binary source," Bell Syst. Tech. J., vol. 56, pp. 427-437, 1977.
9. P. Piret, "Causal sliding block encoders with feedback," IEEE Trans. Inf. Theory, vol. 25, pp. 237-240, Mar. 1979.
10. D. L. Neuhoff and R. K. Gilbert, "Causal source codes," IEEE Trans. Inf. Theory, vol. 28, pp. 701-713, Sep. 1982.
11. T. Linder and R. Zamir, "Causal coding of stationary sources and individual sequences with high resolution," IEEE Trans. Inf. Theory vol. 52, pp. 662-680, Feb. 2006.
12. T. Fine, "Properties of an optimum digital system and applications," IEEE Trans. Inf. Theory, vol. 10, pp. 287-296, Oct. 1964.
13. B. McMillan, "Communication systems which minimize coding noise," Bell Syst. Tech. J., vol. 48, no. 9, pp. 3091-3113, Sep. 1969.
14. T. Ericson, Delayless Information Transmission Linkoping University, Department of Elec. Eng., Linköping, Sweden, Internal Publication LiTH-ISY-I-0260, 1979.
15. T. Ericson, "A result on delayless information tranmission," in International Symposium on Information Theory, Grignano, Italy, Jun. 1979.
16. H. S. Witsenhausen, "Informational aspects of stochastic control," in Proc. Oxford Confe. Stoch. Optim., 1978.
17. D. Teneketzis, "Communication in Decentralized Control," Ph.D. dissertation, Department of EECS, Massachusetts Inst. Technol., Cambridge, MA, 1979.
18. G. Munson, "Causal Information Transmission with Feedback," Ph.D. dissertation, Department of Electrical Engineering, Cornell University,, Ithaca, NY, 1981.
19. A. K. Gorbunov and P. S. Pinsker, "Non-anticipatory and prognostic epsilon entropies and message generation rates," Probl. Inf. Trans. vol. 9, pp. 184-191, 1973.
20. A. K. Gorbunov and P. S. Pinsker, "Prognostic epsilon entropy of a Gaussian message and a Gaussian source," Probl. Inf. Trans., vol. 10, pp. 93-109, 1974.
21. P. S. Pinsker and A. K. Gorbunov, "Delayed epsilon entropy with small mean-square reproduction error," Probl. Inf. Transm., vol. 23, no. 2, pp. 91-95, Apr.-Jun. 1987.
22. S. Engell, "New results on the real-time transmission problem," IEEE Trans. Inf. Theory, vol. 33, pp. 210-218, Mar. 1987.
23. Y.-C. Ho, M. Kastner, and E. Wong, "Teams, signaling, and information theory," IEEE Trans. Autom. Control, vol. 23, pp. 305-312, 1978.
24. N. Merhav and I. Kontoyiannis, "Source coding exponents for zerodelay coding with finite memory," IEEE Trans. Inf. Theory, vol. 49, pp. 609-625, 2003.
25. A. W. Drake, "Observation of A Markov Process Through a Noisy Channel," Sc.D. dissertation, Department of Elec. Eng., Massachusetts Inst. Technol., Cambridge, MA, 1962.
26. J. Devore, "A note on the observation of a Markov source through a noisy channel," IEEE Trans. Inf. Theory, vol. 20, pp. 762-764, 1974.
27. H. S.Witsenhausen, "On the structure of real-time source coders," Bell Syst. Tech. J., vol. 58, no. 6, pp. 1437-1451, Jul.-Aug. 1979.
28. V. S. Borkar, S. K. Mitter, and S. Tatikonda, "Optimal sequential vector quantization of Markov sources," SIAM J. Opt. Contr., vol. 40, no. 1, pp. 135-148, Jan. 2001.
29. J. C. Walrand and P. Varaiya, "Optimal causal coding-decoding problems," IEEE Trans. Inf. Theory, vol. 29, pp. 814-820, Nov. 1983.
30. R. S. Lipster and A. N. Shiryayev, Statistics of Random Processes. New York: Springer-Verlag, 1977, vol. II, Applications.
31. T. Bašar and R. Bansal, "Optimal design of measurement channels and control policies for linear-quadratic stochastic systems," Europ. J. Oper. Res., vol. 93, pp. 226-236, 1994.
32. R. Bansal and T. Başar, "Simultaneous design of measurement channels and control strategies for stochastic systems with feedback," Automatica, vol. 25, pp. 679-694, 1989.
33. D. Teneketzis, "On the structure of optimal real-time encoders and decoders in noisy communication," IEEE Trans. Inf. Theory, pp. 4017-4035, Sep. 2006.
34. P. R. Kumar and P. Varaiya, Stochastic Systems: Estimation Identification and Adaptive Control. Englewood Cliffs, NJ: Prentice Hall, 1986.
35. H. S. Witsenhausen, "A standard form for sequential stochastic control," Mathematical Systems Theory, vol. 7, no. 1, pp. 5-11, 1973.
36. S. Thrun, "Monte Carlo POMDPs," in Advances in Neural Information Processing Systems, S. Solla, T. Leen, and K.-R. Muller, Eds. Cambridge, MA: MIT Press, 2000, vol. 12, pp. 1064-1070.
37. J. M. Porta, N. Vlassis, M. T. J. Spaan, and P. Pouparts, "Point-based value iteration for continuous POMDPs," J. Mach. Learn. Res., vol. 7, pp. 2329-2367, Nov. 2006.
38. A. Brooks, A. Makarenkoa, S. Williamsa, and H. Durrant-Whytea, "Parametric POMDPs for planning in continuous state spaces," Robot. Auton. Syst., no. 11, pp. 887-897, Nov. 2006.
39. E. Brunskill, L. Kaelbling, T. Lozano-Perez, and N. Roy, "Continuous-state POMDPs with hybrid dynamics," in Proc. Tenth Int. Symp. Artificial Intelli. Math., Fort Lauderdale, FL, 2008.
40. G. R. Grimmett and D. R. Stirzaker, Probability and Random Processes New York: Oxford University Press, 2001.
41. J. Marschak and R. Radner, Economic Theory of Teams. New Haven, CT: Yale University Press, 1972.
42. Y.-C. Ho, "Team decision theory and information structures," Proc. IEEE, vol. 68, pp. 644-654, 1980.
43. H. S. Witsenhausen, "Separation of estimation and control for discrete time systems," Proc. IEEE, vol. 59, pp. 1557-1566, Nov. 1971.
44. H. S.Witsenhausen, "Some remarks on the concept of state," in Directions in Large-Scale Systems, Y. C. Ho and S. K. Mitter, Eds. New York: Plenum, 1976, pp. 69-75.
45. R. J. Aumann, "Agreeing to disagree," Ann. Stat., no. 4, pp. 1236-39, 1976.
46. E. B. Dynkin and A. A. Yushkevich, Controlled Markov Processes. : Springer-Verlag, 1975, A Series of Comprehensive Studies in Mathematics.
47. P. Whittle, Optimization Over Time. New York: Wiley, 1983, vol. 2, Wiley Series in Probability and Mathematical Statistics.
48. A. Arapostathis, V. S. Borkar, E. Fernandez-Gaucherand, M. K. Ghosh, and S. I. Marcus, "Discrete-time controlled Markov processes with average cost criterion - A survey," SIAM J. Contr. Optim., vol. 31, no. 2, pp. 282-344, Mar. 1993.
49. O. Hernández-Lerma, Adaptive Markov Control Processes. New York: Springer-Verlag, 1989.
50. Q. Zhang and S. A. Kassam, "Finite-state Markov model for Rayleigh fading channels," IEEE Trans. Commun., vol. 47, pp. 1688-1692, 1999.
51. G. Forney Jr., "Maximum-likelihood sequence estimation of digital sequences in the presence of intersymbol interference," IEEE Trans. Inf. Theory, vol. 18, pp. 363-378, 1972.
52. D. S. Bernstein, S. Zilberstein, and N. Immerman, "The complexity of decentralized control of Markov decision processes," in Proc. 16th Int. Conf. Uncertainty Artif. Intell. (UAI), Stanford, CA, Jun. 2000, pp. 32-27.
53. W. S. Lovejoy, "A survey of partially observable Markov decision processes," Ann. Oper. Res., vol. 28, no. 1, pp. 47-65, 1991.
54. R. Bansal and T. Basar, "Algorithms for partially observed Markov decision processes," Automatica, vol. 25, no. 5, pp. 679-694, 1989.
55. C. C. White, III and W. T. Scherer, "Solution procedures for partially observed Markov decision processes," Oper. Res., vol. 37, no. 5, pp. 791-797, 1989.
56. C. C. White, III, "Partially observed Markov decision processes: A survey," Ann. Oper. Res., vol. 32, 1991.
57. W. Zhang, "Algorithms for Partially Observed Markov Decision Processes," Ph.D. dissertation, Hong Kong University of Science and Technology, Hong Kong, 2001.
58. J. Rust, "Using randomization to break the curse of dimensionality," Econometrica, vol. 65, no. 3, pp. 487-516, 1997.
59. J. Rust, "Dealing with the complexity of economic calculations," in Fundamental Limits to Knowledge in Economics. Sante Fe, NM: Santa Fe Institute, 1996.
60. Y. Polyanskiy, H. V. Poor, and S. Verdu, "New channel coding achievablility bounds," in Proc. IEEE Int. Symp. Inf. Theory, Toronto, ON, Canada, Jul. 6-10, 2008, pp. 1763-1767.
61. L. Wang, R. Colbeck, and R. Renner, "Simple channel coding bounds," in Proc. IEEE Int. Symp. Inf. Theory, Seoul, South Korea, Jul. 3, 2009, pp. 1804-1808.