On the structure of optimal real-time encoders and decoders in noisy communication

IEEE Transactions on Information Theory

Volumn 52, Issue 9, 2006, Pages 4017-4035

  Teneketzis, Demosthenis ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Markov chains; Markov decision theory; Real time decoding; Real time encoding

Indexed keywords

BROADCASTING; DECODING; MARKOV PROCESSES; SIGNAL DISTORTION; SIGNAL ENCODING; SPURIOUS SIGNAL NOISE;

MARKOV DECISION THEORY; NOISY COMMUNICATION; REAL-TIME DECODERS; REAL-TIME ENCODERS;

COMMUNICATION CHANNELS (INFORMATION THEORY);

EID: 33748566810     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2006.880067     Document Type: Article

References (71)

1. R. G. Gallager, Information Theory and Reliable Communication. New York: Wiley, 1968.
2. J. C. Walrand and P. Varaiya, "Optimal causal coding-decoding problems," IEEE Trans. Inf. Theory, vol. IT-29, no. 6, pp. 814-820, Nov. 1983.
3. T. Fine, "Properties of an optimum digital system and applications," IEEE Trans. Inf. Theory, vol. IT-10, pp. 287-296, Oct. 1964.
4. D. L. Neuhoff and R. K. Gilbert, "Causal source codes," IEEE Trans. Inf. Theory, vol. IT-28, no. 6, pp. 701-713, 1982.
5. T. Linder and R. Zamir, "Causal source coding of stationary sources with high resolution," in Proc. ISIT 2001, Washington, D.C.
6. P. Piret, "Causal sliding block encoders with feedback," IEEE Trans. Inf. Theory, vol. IT-25, no. 2, pp. 237-240, Mar. 1979.
7. H. S. Witsenhausen, "On the structure of real-time source coders," Bell Syst. Tech. J., vol. 58, no. 6, pp. 1437-1451, Jul.-Aug. 1978.
8. J. G. Dunham, Optimal Source Coders with Real-Time Constraints, preprint.
9. T. Linder and G. Lugosi, "A zero-delay sequential quantizer for individual sequences," IEEE Trans. Inf. Theory, vol. 47, no. 6, pp. 2533-2538, Sep. 2001.
10. V. S. Borkar, S. K. Mitter, and S. Tatikonda, "Optimal sequential vector quantization of Markov sources," SIAM J. Contr. Optim., vol. 40, no. 1, pp. 135-148, Jan. 2001.
11. N. T. Gaarder and D. Slepian, "On optimal finite-state digital transmission systems," IEEE Trans. Inf. Theory, vol. IT-28, no. 2, pp. 167-186, Mar. 1982.
12. J. G. Gibson, T. R. Fischer, and B. Koo, "Preposterior analysis for differential encoder design," IEEE Trans. Inf. Theory, vol. IT-32, no. 3, pp. 375-382, May 1986.
13. S. P. Lloyd, "Bicausal isomorphism of Bernoulli processes," Bell Lab. Tech. Memo. 75-1217-16, Nov. 1975.
14. G. Szekeres, G. Gabor, and Z. Gyöfri, On the Gaarder-Slepian tracking system conjecture, Department of Mathematics, Statistics, and Computer Science, Tech. Rep., Dalhousie University Halifax, N.S., Canada, 1987.
15. B. McMillan, "Communication systems which minimize coding noise," Bell Syst. Tech. J., vol. 48, no. 9, pp. 3091-3113, Sep. 1969.
16. A. W. Drake, "Observation of a Markov process through a noisy channel," Sc.D. Thesis, Department of Electrical Engineering, MIT, Cambridge, MA, 1962.
17. J. L. Devore, "A note on the observation of a Markov source through a noisy channel," IEEE Trans. Inf. Theory, vol. IT-20, pp. 762-764, 1974.
18. R. S. Liptser and A. N. Shiryayev, Statistics of Random Processes. New York, NY: Springer-Verlag, 1977, vol. II: Applications.
19. S. Tatikonda, "Control Under Communication Constraints," Ph.D. dissertation, Department of EECS, MIT, Cambridge, MA, 2000.
20. T. Basar and R. Bansal, "Optimum design of measurement channels and control policies for linear-quadratic stochastic systems," European J. Oper. Res., vol. 93, pp. 226-236, 1994.
21. R. Bansal and T. Basar, "Simultaneous design of measurement and control strategies for stochastic systems with feedback," Automatica, vol. 25, no. 5, pp. 679-694, 1989.
22. H. S. Witsenhausen, "Informational aspects of stochastic control," in Proc. Oxford Conf. Stoch. Optim., 1978.
23. D. Teneketzis, "Communication in Decentralized Control," Ph.D. dissertation, Department of EECS, MIT, Cambridge, MA, Sep. 1979.
24. G. Munson, "Causal Information Transmission with Feedback," Ph.D. dissertation, School of Electrical Engineering, Cornell University, Ithaca, NY, 1981.
25. A. K. Gorbunov and M. S. Pinsker, "Non-anticipatory and prognostic epsilon entropies and message generation rates," Probl. Inf. Trans., vol. 9, pp. 184-191, 1973.
26. A. K. Gorbunov and M. S. Pinsker, "Prognostic epsilon entropy of a Gaussian message and a Gaussian source," Probl. Inf. Transm., vol. 10, pp. 99-109, 1974.
27. M. S. Pinsker and A. K. Gorbunov, "Epsilon entropy with delay with small mean-square reproduction error," Probl. Inf. Transm., vol. 23, no. 2, pp. 3-8, Apr.-Jun. 1987.
28. S. Engell, "New results on the real-time transmission problem," IEEE Trans. Inf. Theory, vol. IT-33, no. 2, Mar. 1987.
29. Y. C. Ho, M. Kastner, and E. Wong, "Team signaling and information theory," IEEE Trans. Autom. Control, vol. AC-23, no. 2, pp. 305-312, Apr. 1978.
30. T. Ericson, Delayless Information Transmission, Linköping University, Linköping, Sweden, LiTH-ISY-I-0260, 1979.
31. J. C. Kieffer and J. G. Dunham, "On a type of stochastic stability for a class of encoding schemes," IEEE Trans. Inf. Theory, vol. IT-29, no. 6, pp. 793-797, Nov. 1983.
32. J. C. Kieffer, "Stochastic stability for feedback quantization schemes," IEEE Trans. Inf. Theory, vol. IT-28, no. 2, pp. 248-254, Mar. 1982.
33. T. M. Cover and J. A. Thomas, Elements of Information Theory, ser. Telecommunications. New York: Wiley, 1991.
34. A. D. Wyner and J. Ziv, "The rate distortion function for source coding with side information at the decoder," IEEE Trans. Inf. Theory, vol. IT-22, pp. 1-10, 1976.
35. R. D. Smallwood and E. J. Sondik, "The optimal control of partially observable Markov processes over a finite horizon," Oper. Res., vol. 11, pp. 1071-1088, 1973.
36. P. R. Kumar and P. Varaiya, Stochastic Systems: Estimation, Identification, and Adaptive Control. Englewood Cliffs, NJ: Prentice Hall, 1986.
37. T. M. Cover, "Broadcast channels," IEEE Trans. Inf. Theory, vol. IT-18, pp. 2-14, Jan. 1972.
38. R. G. Gallager, "Capacity and coding for degraded broadcast channels," Probl. Inform. Transm., pp. 185-193, July-Sept. 1974.
39. S. I. Gelfand and M. S. Pinsker, "Capacity of a broadcast channel with one deterministic component," Probl. Inf. Transm., vol. 16, no. 1, pp. 17-25, Jan.-Mar 1980.
40. S. I. Gelfand and M. S. Pinsker, "Coding for channel with random parameters," Probl. Contr. Inf. Theory, vol. 9, no. 1, pp. 19-31, 1980.
41. K. Marton, "A coding theorem for the discrete memoryless broadcast channel," IEEE Trans. Inf. Theory, vol. IT-25, pp. 306-311, May 1979.
42. G. Caire and S. Shamai, "On the achievable throughput of a multiantenna Gaussian broadcast channel," IEEE Trans. Inf. Theory, vol. 49, no. 7, pp. 1691-1706, Jul. 2003.
43. S. Viswanath, N. Jindal, and A. Goldsmith, "Duality, achievable rates, and sum-rate capacity of gausian MIMO broadcast channels," IEEE Trans. Inf. Theory, vol. 49, no. 10, pp. 2658-2668, Oct. 2003.
44. T. Cover, "Comments on broadcast channels," IEEE Trans. Inf. Theory, vol. IT-44, no. 6, pp. 2524-2531, Oct. 1998.
45. S. P. Lloyd, "Rate versus fidelity for the binary source," Bell Syst. Tech. J., vol. 56, pp. 427-437, Mar. 1977.
46. A. Sahai, "Anytime Information Theory," Ph.D. dissertation, Dept. EECS, MIT, Cambridge, MA, Feb. 2001.
47. W. S. Lovejoy, "A survey of algorithmic methods for partially observed Markov decision processes," Ann. Oper. Res., vol. 28, 1991.
48. R. J. Aumann, "Agreeing to disagree," Ann. Stat., vol. 4, no. 6, pp. 1236-1239.
49. C. C. White, "Partially observed Markov decision processes: A survey," Ann. Oper. Res., vol. 32.
50. T. Weissman and N. Merhav, "Limited-delay lossy coding for filtering of individual sequences," IEEE Trans. Inf. Theory, vol. IT-48, no. 3, pp. 721-733, Mar. 2002.
51. A. Gyorgi, T. Linder, and G. Lugosi, "A follow the perturbed leader-type algorithm for zero-delay quantization of individual sequences," in Data Compression Conference, Snowbird, UT, Mar. 23-25, 2004.
52. A. Gyorgi, T. Linder, and G. Lugosi, "Efficient adaptive algorithms and minimax bounds for zero-delay lossy source coding," IEEE Trans. Inf. Theory, vol. 52, pp. 2337-2347, Aug. 2004.
53. N. Merhav and I. Kontoyannis, "Source coding exponents for zero-delay coding with finite memory," IEEE Trans. Inf. Theory, vol. IT-49, no. 3, pp. 609-625, Mar. 2003.
54. S. Matloub and T. Weismann, "On competitive zero-delay source-channel coding," in Proc. CISS Conf., Princeton, N.J., Mar. 17-19, 2004.
55. W. Zhang, "Algorithms for Partially Observable Markov Decision Processes," Ph.D. dissertation, The Hong Kong University of Science and Technology,, Aug. 2001.
56. R. Jain and P. Varaiya, "Simulation-based uniform value function estimates of Markov decision processes," SIAM J. Contr. Optim., Nov. 2004.
57. R. Jain, "Efficient Market Mechanisms and Simulation-based Learning for Multi-agent Systems," Ph.D. dissertation, Dep. EECS, , University of California, Berkeley, Berkeley, CA, 2004.
58. W. S. Lovejoy, "Computationally feasible bounds for partially observed Markov decision processes," Oper. Res., vol. 39, no. 1, pp. 162-175, 1991.
59. E. J. Sondik, "The Optimal Control of Partially Observed Markov Decision Processes," Ph.D. Dissertation, Stanford University, Stanford, CA, 1971.
60. E. J. Sondik, "The optimal control of partially observable decision processes over the infinite horizon: Discounted cost," Oper. Res., vol. 26, no. 2, pp. 282-304, 1978.
61. C. C. White III and W. T. Scherer, "Solution procedures for partially observed Markov decision processes," Oper. Res., vol. 37, no. 5, pp. 791-797, 1989.
62. J. Rust, "Structural estimation of Markov decision processes," in Handbook of Econometrics, R. F. Engle and D. L. McFadden, Eds. :ELsevier, 1994, vol. IV, ch. 51, pp. 3081-3143.
63. J. Rust, "Numerical Dynamic Programming in Economics," in Handbook of Computational Economics, H. M. Amman, D. A. Kendrick, and J. Rust, Eds. :ELsevier, 1996, vol. I, ch. 14, pp. 619-729.
64. D. P. Bertsekas and J. N. Tsitsiklis, Neuro-Dynamic Programming. Boston, MA: Athena Scientific, 1996.
65. J. Pineau, G. Gordon, and S. Thrun, "Point-based value iteration: An anytime algorithm for POMDPs," in Proc. Int. Joint Conf. Artif. Intell. (IJCAI), Acapulco, Mexico, 2003, pp. 1025-1032.
66. A. Y. Ng and M. Jordan, "PEGASUS: A policy search method for large MDP's and POMDPs," Proc. Uncertain. Artif. Intell., 2000.
67. P. Pompart and C. Boutilier, "Value-directed compression for POMDPs," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2003, vol. 15.
68. T. Linder and R. Zamir, "Causal source coding of stationary sources with high resolution," in Proc. Int. Symp. Inf. Theory, Washington, DC, Jun. 2001, p. 28.
69. R. B. Washburn and D. Teneketzis, "Asymptotic agreement among communicating decisionmakers," Stochastics, vol. 13, pp. 103-129, 1984.
70. A. Mahajan and D. Teneketzis, "A decision theoretic framework for real-time communication," Proc. 43rd Allerton Conf. Contr., Commun. Comput., Sep. 2005.
71. T. Ericson, "A result on delay-less information transmission," in Proc. Int. Symp. Inf. Theory, Grignano, Italy, Jun. 1979.