Successive Wyner-Ziv coding scheme and its application to the quadratic Gaussian CEO problem

IEEE Transactions on Information Theory

Volumn 54, Issue 4, 2008, Pages 1586-1603

  Chen, Jun ^a   Berger, Toby ^b  

^a MCMASTER UNIVERSITY   (Canada)

^b University of Virginia   (United States)

Author keywords

CEO problem; Contra polymatroid; Rate splitting; Source splitting; Successive refinement; Wyner Ziv coding

Indexed keywords

CODES (SYMBOLS); INFORMATION THEORY; PROBLEM SOLVING;

CONTRA-POLYMATROID; QUADRATIC GAUSSIAN PROBLEM; RATE SPLITTING; SOURCE CODING; SOURCE SPLITTING; WYNER-ZIV CODING;

ENCODING (SYMBOLS);

EID: 41949114601     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2008.917687     Document Type: Article

References (43)

1. D. Schonberg, K. Ramchandran, and S. S. Pradhan, "Distributed code constructions for the entire Slepian-Wolf rate region for arbitrarily correlated sources," in Proc. DCC04, Snowbird, UT, Mar. 2004.
2. T. P. Coleman, A. H. Lee, M. Médard, and M. Effros, "Low-complexity approaches to Slepian-Wolf near-lossless distributed data compression," IEEE Trans. Inf. Theory, vol. 52, no. 8, pp. 3546-3561, Aug. 2006.
3. S. Cheng and Z. Xiong, "Successive refinement for the Wyner-Ziv problem and layered code design," in Proc. DCC04, Snowbird, UT, Mar. 2004.
4. D. Slepian and J. K. Wolf, "Noiseless coding of correlated information sources," IEEE Trans. Inf. Theory, vol. IT-19, no. 4, pp. 471-480, July 1973.
5. A. D.Wyner and J. Ziv, "The rate-distortion function for source coding with side information at the decoder," IEEE Trans. Inf. Theory, vol. 22, no. 1, pp. 1-10, Jan. 1976.
6. J. Edmonds, "Submodular functions, matroids and certain polyhedra," in Combinatorial Structures and Their Applications, R. Guy, H. Hanani, N. Sauer, and J. Schonheim, Eds. New York: Gordon and Breach, 1970, pp. 69-87.
7. T. S. Han, "Source coding with cross observations at the encoders," IEEE Trans. Inf. Theory, vol. IT-25, no. 3, pp. 360-361, May 1979.
8. T. S. Han, "Slepian-Wolf-Cover theorem for networks of channels," Inf. Contr., vol. 47, pp. 67-83, Oct. 1980.
9. B. Rimoldi and R. Urbanke, "Asynchronous Slepian-Wolf coding via source-splitting," in IEEE Int. Symp. Inf. Theory, Ulm, Germany, Jun. 29-Jul. 4, 1997, p. 271.
10. R. Zamir, S. Shamai, and U. Erez, "Nested linear/lattice codes for structured multiterminal binning," IEEE Trans. Inf. Theory, vol. 48, pp. 1250-1276, Jun. 2002.
11. A. B. Carleial, "On the capacity of multiple-terminal communication networks," Ph.D. dissertation, Stanford Univ., Stanford, CA, Aug. 1975.
12. B. Rimoldi and R. Urbanke, " A rate-splitting approach to the Gaussian multiple- access channel," IEEE Trans. Inf. Theory, vol. 42, no. 2, pp. 364-375, Mar. 1996.
13. A. J. Grant, B. Rimoldi, R. L. Urbanke, and P. A. Whiting, "Rate-splitting multiple access for discrete memoryless channels," IEEE Trans. Inf. Theory, vol. 47, no. 3, pp. 873-890, Mar. 2001.
14. B. Rimoldi, "Generalized time sharing: A low-complexity capacity-achieving multiple- access technique," IEEE Trans. Inf. Theory, vol. 47, no. 6, pp. 2432-2442, Sep. 2001.
15. S. I. Gel'fand and M. S. Pinsker, "Coding of sources on the basis of observations with incomplete information," Problems of Information Transmission, vol. 15, no. 2, pp. 115-125, 1979.
16. T. J. Flynn and R. M. Gray, "Encoding of correlated observations," IEEE Trans. Inf. Theory, vol. IT-33, no. 6, pp. 773-787, Nov. 1987.
17. T. Berger, Z. Zhang, and H. Viswanathan, "The CEO problem," IEEE Trans. Inf. Theory, vol. 42, no. 3, pp. 887-902, May 1996.
18. T. Berger, "Multiterminal source coding," in The Information Theory Approach to Communications, ser. CISM Courses and Lectures, G. Longo, Ed. Vienna/New York: Springer-Verlag, 1978, pp. 171-231.
19. S. Y. Tung, "Multiterminal source coding," Ph.D. dissertation, School of Elect. Eng., Cornell Univ., Ithaca, NY, May 1978.
20. T. Berger, K. Housewright, J. Omura, S. Y. Tung, and J. Wolfowitz, "An upper bound on the rate-distortion function for source coding with partial side information at the decoder," IEEE Trans. Inf. Theory vol. IT-25, no. 6, pp. 664-666, Nov. 1979.
21. J. Körner and K. Marton, "How to encode the modulo-two sum of binary sources," IEEE Trans. Inf. Theory, vol. IT-25, no. 2, pp. 219-221, Mar. 1979.
22. P. Viswanath, "Sum rate of multiterminal gaussian source coding," in Advances in Network Information Theory, DIMACS: Series in Discrete Mathematics and Theoretical Computer Science, P. Gupta, G. Kramer, and A. Wijngaarden, Eds. Providence, RI: American Mathematical Society, 2004, pp. 43-60.
23. J. Chen, X. Zhang, T. Berger, and S. B. Wicker, "An upper bound on the sum- Rate distortion function and its corresponding rate allocation schemes for the CEO problem," IEEE J. Sel. Areas Commun., vol. 22, no. 6, pp. 977-987, Aug. 2004.
24. H. G. Eggleston, Convexity. Cambridge, U.K.: Cambridge Univ. Press, 1958.
25. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
26. S. C. Draper and G. W. Wornell, "Side information aware coding strategies for sensor networks," IEEE J. Sel. Areas Commun., vol. 22, no. 6, pp. 966-976, Aug. 2004.
27. B. Rimoldi and R. Urbanke, "On the structure of the dominant face of multiple access channels," in Proc. Inf. Theory Commun. Workshop, Kruger National Park, South Africa, Jun. 20-25, 1999, pp. 12-14.
28. R. Ahlswede, "Multi-way communication channels," in Proc. 2nd Int. Symp. Inf. Theory, Budapest, Hungary, 1973, pp. 23-52, Hungarian Acad. Sci..
29. H. Liao, "Multiple access channels," Ph.D. dissertation, Dep. Elec. Eng., Univ. Hawaii, Honolulu, HI, 1972.
30. T. S. Han, "The capacity region of general multiple-access channel with certain correlated sources," Inf. Contr., vol. 40, pp. 37-60, Jan. 1979.
31. D. N. C. Tse and S. V. Hanly, "Multiaccess fading channels - Part I: Polymatroid structure, optimal resource allocation and throughput capacities," IEEE Trans. Inf. Theory, vol. 44, no. 7, pp. 2796-2815, Nov. 1998.
32. A. D.Wyner, "The rate-distortion function for source coding with side information at the decoder-II: General sources," Inf. Contr., vol. 38, pp. 60-80, Jul. 1978.
33. Y. Oohama, "Gaussian multiterminal source coding," IEEE Trans. Inf. Theory, vol. 43, no. 6, pp. 1912-1923, Nov. 1997.
34. Y. Oohama, "The rate-distortion function for the quadratic Gaussian CEO problem," IEEE Trans. Inf. Theory, vol. 44, no. 3, pp. 1057-1070, May 1998.
35. H. Viswanathan and T. Berger, "The quadratic Gaussian CEO problem," IEEE Trans. Inf. Theory, vol. 43, no. 5, pp. 1549-1559, Sept. 1997.
36. Y. Oohama, "Rate-distortion theory for Gaussian multiterminal source coding systems with several side informations at the decoder," IEEE Trans. Inf. Theory, vol. 51, no. 7, pp. 2577-2593, Jul. 2005.
37. V. Prabhakaran, D. Tse, and K. Ramchandran, "Rate region of the quadratic Gaussian CEO problem," in Proc. Int. Symp. Inf. Theory, Chicago, IL, Jun. 27-Jul. 2, 2004, p. 119 [Online]. Available: http:// www.eecs.berkeley.edu/~vinodmp/publications/ISIT04a.pdf
38. S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge, U.K.: Cambridge Univ. Press, 2004.
39. V. Koshelev, "Hierarchical coding of discrete sources," Probl. Pered. Inf., vol. 16, no. 3, pp. 31-49, 1980.
40. V. Koshelev, "Estimation of mean error for a discrete successive-approximation scheme," Probl. Pered. Inf., vol. 17, no. 3, pp. 20-33, 1981.
41. W. H. R. Equitz and T. M. Cover, "Successive refinement of information," IEEE Trans. Inf. Theory, vol. 37, no. 2, pp. 269-274, Mar. 1991.
42. B. Rimoldi, "Successive refinement of information: Characterization of the achievable rates," IEEE Trans. Inf. Theory, vol. 40, no. 1, pp. 253-259, Jan. 1994.
43. Y. Steinberg and N. Merhav, "On successive refinement for the Wyner-Ziv problem," IEEE Trans. Inf. Theory, vol. 50, no. 8, pp. 1636-1654, Aug. 2004.