On the structure of real-time encoding and decoding functions in a multiterminal communication system

IEEE Transactions on Information Theory

Volumn 57, Issue 9, 2011, Pages 6196-6214

  Nayyar, Ashutosh ^a   Teneketzis, Demosthenis ^a  

^a The Department of Civil and Environmental Engineering   (United States)

Author keywords

Markov chains; Markov decision theory; multiterminal communication system; real time encoding and decoding

Indexed keywords

COMMON INFORMATION; DISTORTION MEASURES; ENCODING AND DECODING; FINITE MEMORY; MARKOV DECISION THEORY; MARKOV SOURCES; MULTI TERMINALS; NOISELESS CHANNELS; NOISY CHANNEL; PARTIAL OBSERVATION; REAL-TIME COMMUNICATION SYSTEM; REAL-TIME ENCODERS; REAL-TIME ENCODING; SUFFICIENT STATISTICS; TIME INVARIANTS;

COMMUNICATION SYSTEMS; DECISION THEORY; DECODING; ENCODING (SYMBOLS); MARKOV PROCESSES; RANDOM VARIABLES; REAL TIME SYSTEMS; STRUCTURAL OPTIMIZATION;

REAL VARIABLES;

EID: 80052345835     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2011.2161915     Document Type: Article

References (41)

1. R. G. Gallager, Information Theory and Reliable Communication. Hoboken, NJ: Wiley, 1968.
2. D. Slepian and J. K. Wolf, "Noiseless coding of correlated information sources", IEEE Trans. Inf. Theory, vol. IT-19, pp. 471-480, 1973.
3. D. Slepian and J. K. Wolf, "A coding theorem for multiple access channels with correlated sources", Bell Syst. Tech. J., vol. 52, pp. 1037-1076, Sep. 1973.
4. T. M. Cover, A. E. Gamal, and M. Salehi, "Multiple-access channel with arbitrarily correlated sources", IEEE Trans. Inf. Theory, vol. IT-26, pp. 648-659, 1980.
5. T. J. Flynn and R. M. Gray, "Encoding of correlated observations", IEEE Trans. Inf. Theory, vol. IT-33, no. 6, Nov. 1987.
6. A. Wyner, "Recent results in the shannon theory", IEEE Trans. Inf. Theory, vol. IT-20, no. 1, pp. 2-10, Jan. 1974.
7. Q. Zhao and M. Effros, "Optimal code design for lossless and near lossless source coding in multiple access networks", in Proc. Data Compression Conf. (DCC), Snowbird, UT, 2001, pp. 263-272.
8. A. K. A. Jabri and S. Al-Issa, "Zero-error codes for correlated information sources", in Proc. Cryptography, Cirencester, U. K., Dec. 1997, pp. 17-22.
9. S. S. Pradhan and K. Ramchandran, "Distributed source coding using syndromes (discus) design and construction", in Proc. Data Compression Conf. (DCC), Snowbird, UT, Mar. 1999, pp. 158-167.
10. T. Berger, Z. Zhang, and H. Viswanathan, "The CEO problem", IEEE Trans. Inf. Theory, vol. 42, no. 5, pp. 887-902, May 1996.
11. H. Viswanathan and T. Berger, "The quadratic gaussian ceo problem", IEEE Trans. Inf. Theory, vol. 43, no. 9, pp. 1549-1559, Sep. 1997.
12. Y. Oohama, "The rate-distortion function for the quadratic gaussian ceo problem", IEEE Trans. Inf. Theory, vol. 44, no. 5, pp. 1057-1070, May 1998.
13. S. C. Draper and G. W. Wornell, "Successively structured ceo problems", in Proc. ISIT 2002, Lausanne, Switzerland, Jun. 5, 2002, pp. 65-65.
14. J. Chen, X. Zhang, T. Berger, and S. B. Wicker, "An upper bound on the sum-rate distortion function and its corresponding rate allocation schemes for the ceo problem", IEEE J. Sel. Areas Commun., vol. 22, no. 6, Aug. 2004.
15. T. Berger and S. Tung, "Encoding of correlated analog sources", in Proc. IEEEUSSR Joint Workshop on Information Theory, 1975, pp. 7-10.
16. R. Zamir and T. Berger, "Multiterminal source coding with high resolution", IEEE Trans. Inf. Theory, vol. 45, no. 1, pp. 106-117, Jan. 1999.
17. Y. Oohama, "Gaussian multiterminal source coding", IEEE Trans. Inf. Theory, vol. 43, no. 11, pp. 1912-1923, Nov. 1997.
18. D. Krithivasan and S. S. Pradhan, "Lattices for distributed source coding: Jointly gaussian sources and reconstruction of a linear function", IEEE Trans. Inf. Theory, submitted for publication.
19. S. I. Gelfand and M. S. Pinsker, "Coding of sources on the basis of observations with incomplete information", Probl. Inform. Transmission, vol. 15, no. 2, pp. 115-125, 1979.
20. J. Korner and K. Marton, "How to encode the modulo-two sum of binary sources", IEEE Trans. Inf. Theory, vol. IT-25, pp. 219-221, 1979.
21. T. S. Han and K. Kobayashi, "A dichotomy of functions F (X, Y) of correlated sources (X, Y)", IEEE Trans. Inf. Theory, vol. 33, pp. 69-76, 1987.
22. R. Ahlswede and T. S. Han, "On source coding with side information via a multiple-access channel and related problems in multi-user information theory", IEEE Trans. Inf. Theory, vol. 29, pp. 396-412, 1983.
23. I. Csiszar and J. Korner, Information Theory: Coding Theorems for Discrete Memoryless Systems. London, U. K.: Academic, 1981.
24. Y. C. Ho, "Team decision theory and information structures", Proc. IEEE, vol. 68, no. 6, pp. 644-654, Jun. 1980.
25. H. S. Witsenhausen, "A counterexample in stochastic optimum control", SIAM J. Control Optim., vol. 6, no. 1, pp. 131-147, 1968.
26. H. Witsenhausen, "On the structure of real-time source coders", Bell Sys. Tech. J., vol. 58, pp. 1437-1451, Aug. 1978.
27. D. Teneketzis, "On the structure of real-time encoders and decoders in noisy communication", IEEE Trans. Inf. Theory, vol. 52, no. 9, pp. 5-11, Sep. 2006.
28. J. Walrand and P. Varaiya, "Optimal causal coding-decoding problems", IEEE Trans. Inf. Theroy, vol. IT-29, no. 6, pp. 814-820, Nov. 1983.
29. V. S. Borkar, S. K. Mitter, and S. Tatikonda, "Optimal sequential vector quantization of Markov sources", SIAM J. Control Optim., vol. 40, no. I, pp. 135-148, Jan. 2001.
30. S. Yuksel and T. Basar, "Causal coding of Markov sources with continuous alphabets", in Analysis and Design of Nonlinear Control Systems: In Honor of Alberto Isidori Astolfi, Alessandro; Marconi, Lorenzo (Eds.). New York: Springer, 2008.
31. A. Mahajan and D. Teneketzis, "On the design of globally optimal communication strategies for real-time communication systems with noisy feedback", IEEE J. Sel. Areas Commun., vol. 26, no. 4, pp. 580-595, May 2008.
32. A. Mahajan and D. Teneketzis, "Optimal design of sequential real-time communication systems", IEEE Trans. Inf. Theory, vol. 55, no. 11, pp. 5317-5337, Nov. 2009.
33. R. J. Aumann, "Agreeing to disagree", Ann. Statist., vol. 4, no. 6, pp. 1236-1239, 1976.
34. P. R. Kumar and P. Varaiya, Stochastic Systems: Estimation Identification and Adaptive Control. Upper Saddle River, NJ: Prentice-Hall, 1986.
35. M. H. DeGroot, Optimal Statistical Decisions. New York: McGraw-Hill, 1970.
36. A. Mahajan, A. Nayyar, and D. Teneketzis, "Identifying tractable decentralized control problems onthe basis ofinformation structure", presented at the 46th Annu. Allerton Conf., 2008.
37. R. D. Smallwood and E. J. Sondik, "The optimal control of partially observable Markov processes over a finite horizon", Oper. Res., vol. II, pp. 1071-1088, 1973.
38. A. Nayyar and D. Teneketzis, "On jointly optimal real-time encoding and decoding strategies in multiterminal communication systems", presented at the 47th IEEE Conf. Decision and Control, Dec. 2008.
39. H. Witsenhausen, "A standard form for sequential stochastic control", Math. Syst. Theory, vol. 7, no. 1, pp. 5-11, 1973.
40. A. Mahajan, "Sequential Decomposition of Sequential Dynamic Teams: Applications to Real-Time Communication and Networked Control Systems", Ph. D. dissertation, University of Michigan, Ann Arbor, 2008.
41. N. T. Gaarder and D. Slepian, "On optimal finite-state digital transmission systems", IEEE Trans. Inf. Theory, vol. IT-28, no. 2, pp. 167-186, Mar. 1982.