Robust distributed source coding

IEEE Transactions on Information Theory

Volumn 54, Issue 8, 2008, Pages 3385-3398

  Chen, Jun ^a   Berger, Toby ^b  

^a MCMASTER UNIVERSITY   (Canada)

^b University of Virginia   (United States)

Author keywords

CEO problem; Common information; Distributed source coding; Multiple description coding

Indexed keywords

COMMUNICATION CHANNELS (INFORMATION THEORY); IMAGE COMPRESSION;

CEO PROBLEM; CODING SCHEMES; COMMON INFORMATION; COMPRESSION EFFICIENCY; DISTRIBUTED CODING; DISTRIBUTED SOURCE CODING; MULTIPLE DESCRIPTION CODING; OPTIMALITY; SYSTEM ROBUSTNESS; TRANSMISSION RATES;

PROGRAMMING THEORY;

EID: 48849097837     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2008.926389     Document Type: Article

References (54)

1. D. Slepian and J. K. Wolf, "Noiseless coding of correlated information sources," IEEE Trans. Inf. Theory, vol. IT-19, no. 4, pp. 471-480, Jul. 1973.
2. T. M. Cover, "A proof of the data compression theorem of Slepian and Wolf for ergodic sources," IEEE Trans. Inf. Theory, vol. IT-21, no. 2, pp. 226-228, Mar. 1975.
3. A. D. Wyner and J. Ziv, "The rate-distortion function for source coding with side information at the decoder," IEEE Trans. Inf. Theory, vol. IT-22, no. 1, pp. 1-10, Jan. 1976.
4. T. Berger, "Multiterminal source coding," in The Information Theory Approach to Communications (CISM Courses and Lectures, no. 229), G. Longo, Ed. Vienna/New York: Springer-Verlag, 1978, pp. 171-231.
5. S. Y. Tung, "Multiterminal Source Coding," Ph.D. dissertation, School of Electrical Engineering, Cornell Univ, Ithaca, NY, May 1978.
6. T. Berger and R. W. Yeung, "Multiterminal source encoding with one distortion criterion," IEEE Trans. Inf. Theory, vol. 35, no. 2, pp. 228-236, Mar. 1989.
7. M. Gastpar, "The Wyner-Ziv problem with multiple sources," IEEE Trans. Inf. Theory, vol. 50, no. 11, pp. 2762-2768, Nov. 2004.
8. Y. Oohama, "Gaussian multiterminal source coding," IEEE Trans. Inf. Theory, vol. 43, no. 6, pp. 1912-1923, Nov. 1997.
9. P. Viswanath, "Sum rate of multiterminal Gaussian source coding," in Advances in Network Information Theory, P. Gupta, G. Kramer, and A. Wijngaarden, Eds. Providence, RI: Amer. Math. Soc., 2004, pp. 43-60, DIMACS Series in Discrete Mathematics and Theoretical Computer Science.
10. S. I. Gel'fand and M. S. Pinsker, "Coding of sources on the basis of observations with incomplete information," Probl. Inf. Transm., vol. 15, no. 2, pp. 115-125, 1979.
11. T. J. Flynn and R. M. Gray, "Encoding of correlated observations," IEEE Trans. Inf. Theory, vol. IT-33, no. 6, pp. 773-787, Nov. 1987.
12. T. Berger, Z. Zhang, and H. Viswanathan, "The CEO problem," IEEE Trans. Inf. Theory, vol. 42, no. 3, pp. 887-902, May 1996.
13. H. Viswanathan and T. Berger, "The quadratic Gaussian CEO problem," IEEE Trans. Inf. Theory, vol. 43, no. 5, pp. 1549-1559, Sep. 1997.
14. S. C. Draper and G. W. Wornell, "Side information aware coding strategies for sensor networks," IEEE J. Select. Areas Commun., vol. 22, no. 6, pp. 966-976, Aug. 2004.
15. Y. Oohama, "The rate-distortion function for the quadratic Gaussian CEO problem," IEEE Trans. Inf. Theory, vol. 44, no. 3, pp. 1057-1070, May 1998.
16. J. Chen, X. Zhang, T. Berger, and S. B. Wicker, "An upper bound on the sum-rate distortion function and its corresponding rate allocation schemes for the CEO problem," IEEE J. Select. Areas Commun., vol. 22, no. 6, pp. 977-987, Aug. 2004.
17. Y. Oohama, "Rate-distortion theory for Gaussian multiterminal source coding systems with several side informations at the decoder," IEEE Trans. Inf. Theory, vol. 51, no. 7, pp. 2577-2593, Jul. 2005.
18. V. Prabhakaran, D. N. C. Tse, and K. Ramchandran, "Rate region of the quadratic Gaussian CEO problem," in Proc. IEEE Int. Symp. Information Theory, Chicago, IL, Jun./Jul. 2004, p. 119.
19. H. Witsenhausen, "On source networks with minimal breakdown degradation," Bell Syst. Tech. J., vol. 59, no. 6, pp. 1083-1087, July-Aug. 1980.
20. J. Wolf, A. Wyner, and J. Ziv, "Source coding for multiple descriptions," Bell Syst. Tech. J., vol. 59, no. 8, pp. 1417-1426, Oct. 1980.
21. L. Ozarow, "On a source coding problem with two channels and three receivers," Bell Syst. Tech. J., vol. 59, no. 10, pp. 1909-1921, Dec. 1980.
22. H. S. Witsenhausen and A. D. Wyner, "Source coding for multiple descriptions II: A binary source," Bell Syst. Tech. J., vol. 60, pp. 2281-2292, Nov. 1981.
23. A. A. El Gamal and T. M. Cover, "Achievable rates for multiple descriptions," IEEE Trans. Inf. Theory, vol. IT-28, no. 6, pp. 851-857, Nov. 1982.
24. R. Ahlswede, "The rate-distortion region for multiple descriptions without excess rate," IEEE Trans. Inf. Theory, vol. IT-31, no. 6, pp. 721-726, Nov. 1985.
25. R. Ahlswede, "On multiple descriptions and team guessing," IEEE Trans. Inf. Theory, vol. IT-32, no. 4, pp. 543-549, Jul. 1986.
26. Z. Zhang and T. Berger, "New results in binary multiple descriptions," IEEE Trans. Inf. Theory, vol. IT-33, no. 4, pp. 502-521, Jul. 1987.
27. R. Zamir, "Gaussian codes and Shannon bounds for multiple descriptions," IEEE Trans. Inf. Theory, vol. 45, no. 7, pp. 2629-2635, Nov. 1999.
28. F. W. Fu and R. W. Yeung, "On the rate-distortion region for multiple descriptions," IEEE Trans. Inf. Theory, vol. 48, no. 7, pp. 2012-2021, Jul. 2002.
29. R. Venkataramani, G. Kramer, and V. K. Goyal, "Multiple description coding with many channels," IEEE Trans. Inf. Theory, vol. 49, no. 9, pp. 2106-2114, Sep. 2003.
30. S. S. Pradhan, R. Puri, and K. Ramchandran, "n-channel symmetric multiple descriptions-part I: (n,k) source-channel erasure codes," IEEE Trans. Inf. Theory, vol. 50, no. 1, pp. 47-61, Jan. 2004.
31. R. Puri, S. S. Pradhan, and K. Ramchandran, "n-channel symmetric multiple descriptions - part II: An achievable rate-distortion region," IEEE Trans. Inf. Theory, vol. 51, no. 4, pp. 1377-1392, Apr. 2005.
32. J. Wolf and J. Ziv, "Transmission of noisy information to a noisy receiver with minimum distortion," IEEE Trans. Inf. Theory, vol. IT-16, no. 4, pp. 406-411, Jul. 1970.
33. T. Berger, Rate Distortion Theory. Englewood Cliffs, NJ: Prentice-Hall, 1971.
34. P. Ishwar, R. Puri, K. Ramchandran, and S. S. Pradhan, "On rate-constrained distributed estimation in unreliable sensor networks," IEEE J. Select. Areas Commun, vol. 23, no. 4, pp. 765-775, Apr. 2005.
35. J. R. Roche, "Distributed Information Storage," Ph.D. dissertation, Stanford Univ., Stanford, CA, Mar. 1992.
36. R. W. Yeung, "Multilevel diversity coding with distortion," IEEE Trans. Inf. Theory, vol. 41, no. 2, pp. 412-422, Mar. 1995.
37. J. R. Roche, R. W. Yeung, and K. P. Hau, "Symmetrical multilevel diversity coding," IEEE Trans. Inf. Theory, vol. 43, no. 3, pp. 1059-1064, May 1997.
38. R. W. Yeung and Z. Zhang, "On symmetrical multilevel diversity coding," IEEE Trans. Inf. Theory, vol. 45, no. 2, pp. 609-621, Mar. 1999.
39. R. W. Yeung and Z. Zhang, "Distributed source coding for satellite communications," IEEE Trans. Inf. Theory, vol. 45, no. 4, pp. 1111-1120, May 1999.
40. I. Csiszár and J. Körner, Information Theory: Coding Theorems for Discrete Memoryless Systems. New York: Academic, 1981.
41. J. Edmonds, "Submodular functions, matroids and certain polyhedra," in Combinatorial Structures and Their Applications (Proc. Calgary Int. Conf. 1969), R. Guy, H. Hanani, N. Sauer, and J. Schonheim, Eds. New York: Gordon and Breach, 1970, pp. 69-87.
42. J. Körner and K. Marton, "How to encode the modulo-two sum of binary sources," IEEE Trans. Inf. Theory, vol. IT-25, no. 2, pp. 219-221, Mar. 1979.
43. C. Heegard and T. Berger, "Rate distortion when side information may be absent," IEEE Trans. Inf. Theory, vol. IT-31, no. 6, pp. 727-734, Nov. 1985.
44. P. Gács and J. Körner, "Common information is far less than mutual information," Probl. Contr. Inf. Theory, vol. 2, pp. 149-162, 1973.
45. H. S. Witsenhausen, "On sequences of pairs of dependent random variables," SIAM J. Appl. Math., vol. 28, pp. 100-113, Jan. 1975.
46. T. M. Cover, A. A. El Gamal, and M. Salehi, "Multiple access channels with arbitrarily correlated sources," IEEE Trans. Inf. Theory, vol. IT-26, no. 6, pp. 648-657, Nov. 1980.
47. A. D. Wyner, "The rate-distortion function for source coding with side information at the decoder-II: General sources," Inf. Contr., vol. 38, pp. 60-80, Jul. 1978.
48. H. Feng and M. Effros, "On the achievable region for multiple description source codes on gaussian sources," in Proc. IEEE Int. Symp. Information Theory, Yokohama, Japan, Jun./Jul. 2003, p. 195.
49. J. Chen, C. Tian, T. Berger, and S. S. Hemami, "Multiple description quantization via Gram-Schmidt orthogonalization," IEEE Trans. Inf. Theory, vol. 52, no. 12, pp. 5197-5217, Dec. 2006.
50. J. Chen and A. B. Wagner, "A semicontinuity theorem and its application to network source coding," in Proc. IEEE Int. Symp. Information Theory, Toronto, ON, Canada, Jul. 2008, submitted for publication.
51. T. S. Han and K. Kobayashi, "A unified achievable rate region for a general class of multiterminal source coding systems," IEEE Trans. Inf. Theory, vol. IT-26, no. 3, pp. 277-288, May 1980.
52. T. Berger and R. W. Yeung, "Multiterminal source encoding with encoder breakdown," IEEE Trans. Inf. Theory, vol. 35, no. 2, pp. 237-244, Mar. 1989.
53. R. Ahlswede and J. Körner, "Source coding with side information and converse for degraded broadcast channel," IEEE Trans. Inf. Theory vol. IT-21, no. 6, pp. 629-637, Dec. 1975.
54. N. M. Blachman, "The convolution inequality for entropy powers," IEEE Trans. Inf. Theory, vol. IT-11, no. 2, pp. 267-271, Apr. 1965.