Lattices for distributed source coding: Jointly Gaussian sources and reconstruction of a linear function

IEEE Transactions on Information Theory

Volumn 55, Issue 12, 2009, Pages 5628-5651

  Krithivasan, Dinesh ^a   Pradhan, S Sandeep ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Distributed source coding; Function reconstruction; Lattice codes; Structured coding; Tung inner bound

Indexed keywords

DISTRIBUTED SOURCE CODING; FUNCTION RECONSTRUCTION; LATTICE CODES; STRUCTURED CODING; TUNG INNER BOUND;

DECODING; ELECTRIC DISTORTION; INFORMATION THEORY; OPTIMIZATION; SIGNAL DISTORTION; VECTOR QUANTIZATION;

REPAIR;

EID: 77955615916     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2009.2032853     Document Type: Article

References (62)

1. D. Slepian and J. K.Wolf, "Noiseless coding of correlated information sources," IEEE Trans. Inf. Theory, vol.IT-19, no.4, pp. 471-480, Jul. 1973.
2. A. D. Wyner, "Recent results in Shannon theory," IEEE Trans. Inf. Theory, vol.IT-20, no.1, pp. 2-10, Jan. 1974.
3. A. D.Wyner, "On source coding with side information at the decoder,"IEEE Trans. Inf. Theory, vol.IT-21, no.3, pp. 294-300, May 1975.
4. R. Ahlswede and J. Körner, "Source coding with side information and a converse for degraded broadcast channels," IEEE Trans. Inf. Theory, vol.IT-21, no.6, pp. 629-637, Nov. 1975.
5. A. D.Wyner and J. Ziv, "The rate-distortion function for source coding with side information at the decoder," IEEE Trans. Inf. Theory, vol.IT-22, no.1, pp. 1-10, Jan. 1976.
6. T. Berger, "Multiterminal source coding," presented at the CISMSummer School on the Information Theory Approach to Communications, July 1977.
7. S.-Y. Tung, "Multiterminal Source Coding," Ph.D. dissertation, School of Electrical Engineering, Cornell Univ., Ithaca, NY, May 1978.
8. T. Berger, K. B. Housewright, J. K. Omura, S. Tung, and J.Wolfowitz, "An upper bound on the rate distortion function for source coding with partial side information at the decoder," IEEE Trans. Inf. Theory, vol.IT-25, no.6, pp. 664-666, Nov. 1979.
9. S. Gelfand and M. Pinsker, "Coding of sources on the basis of observations with incomplete information," Probl. Pered. Inform., vol.15, pp. 45-57, Apr.-June 1979.
10. J. Körner and K. Marton, "How to encode the modulo-two sum of binary sources," IEEE Trans. Inf. Theory, vol.IT-25, no.2, pp. 219-221, Mar. 1979.
11. T. S. Han, "Source coding with cross observations at the encoders," IEEE Trans. Inf. Theory, vol.IT-25, no.3, pp. 360-361, May 1979.
12. I. Csiszár and J. Körner, Information Theory: Coding Theorems for Discrete Memoryless Systems. New York: Academic, 1981.
13. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
14. T. S. Han and K. Kobayashi, "A dichotomy of functions F(X,Y) of correlated sources (X,Y)," IEEE Trans. Inf. Theory, vol.IT-33, no.1, pp. 69-76, Jan. 1987.
15. R. Ahlswede and T. S. Han, "On source coding with side information via a multiple-access channel and related problems in multi-user information theory," IEEE Trans. Inf. Theory, vol.IT-29, no.3, pp. 396-412, May 1983.
16. R. W. Yeung and T. Berger, "Multiterminal source coding with one distortion criterion," IEEE Trans. Inf. Theory, vol.35, no.2, pp. 228-236, Mar. 1989.
17. H. Viswanathan, Z. Zhang, and T. Berger, "The CEO problem," IEEE Trans. Inf. Theory, vol.42, no.3, pp. 88-902, May 1996.
18. H. Viswanathan and T. Berger, "The quadratic Gaussian CEO problem," IEEE Trans. Inf. Theory, vol.43, no.5, pp. 1549-1559, Sep. 1997.
19. P. Viswanath, "Sumrate of multiterminal Gaussian source coding," in Proc. DIMACSWorkshop on Network Information Theory, Piscataway, NJ, Apr. 2002.
20. H. Yamamoto and K. Itoh, "Source coding theory for multiterminal communication systems with a emote source," Trans. IECE Japan, vol.E-63, pp. 700-706, Oct. 1980.
21. T. J. Flynn and R. M. Gray, "Encoding of correlated observations," IEEE Trans. Inf. Theory, vol.IT-33, no.6, pp. 773-787, Nov. 198.
22. R. Dobrushin and B. Tsybakov, "Information transmission with additionalnoise," IRE Trans. Inf. Theory, vol.IT-8, no.5, pp. 293-304, Sep. 1962.
23. H. S. Witsenhausen, "Indirect rate distortion problems," IEEE Trans.Inf. Theory, vol.IT-26, no.5, pp. 518-521, Sep. 1980.
24. Y. Oohama, "Gaussian multiterminal source coding," IEEE Trans. Inf. Theory, vol.43, no.6, pp. 1912-1923, Nov. 1997.
25. Y. Oohama, "The rate-distortion function for the quadratic Gaussian CEO problem," IEEE Trans. Inf. Theory, vol.44, no.3, pp. 1057-1070, May 1998.
26. Y. Oohama, "Rate-distortion theory for Gaussian multiterminal source coding systems with several side informations at the decoder," IEEE Trans. Inf. Theory, vol.51, no.7, pp. 257-2593, Jul. 2005.
27. Y. Oohama, "Rate distortion region for separate coding of correlated Gaussian remote observations," in Proc. 43rd Annu. Allerton Conf. Communication, Control and computing, Monticello, IL, Sep. 2005.
28. Y. Oohama, "Separate source coding of correlated Gaussian remote sources," in Proc. Workshop on Information Theory and Applications (ITA), San Diego, CA, Jan. 2006.
29. A. B. Wagner and V. Anantharam, "An improved outer bound for the multiterminal source-coding problem," in Proc. IEEE Int. Symp. Information Theory (ISIT'05), Adelaide, Australia, Sep. 2005, pp. 1406-1410.
30. V. Prabhakaran, K. Ramchandran, and D. Tse, "Rate region of the quadratic Gaussian CEO problem," in Proc. IEEE Int. Symp. Information Theory (ISIT'04), Chicago, IL, Jun./Jul. 2004, p. 11.
31. A. Orlitsky and J. R. Roche, "Coding for computing," IEEE Trans. Inf. Theory, vol.47, no.3, pp. 903-917, Mar. 2001.
32. H. Yamamoto, "Wyner-Ziv theory for a general function of the correlated sources," IEEE Trans. Inf. Theory, vol.IT-28, no.5, pp. 803-807, Sep. 1982.
33. H. Feng, M. Effros, and S. A. Savari, "Functional source coding for networks with receiver side information," in Proc. 42nd Annu. AllertonConf. Communication, Control and Computing, Monticello, IL, Sep. 2004.
34. M. Gastpar, "The Wyner-Ziv problem with multiple sources," IEEE Trans. Inf. Theory, vol.50, no.11, pp. 2762-2768, Nov. 2004.
35. A. B. Wagner, S. Tavildar, and P. Viswanath, "Rate region of the quadratic Gaussian two-terminal source-coding problem," IEEE Trans. Inf. Theory, vol.54, no.5, pp. 1938-1961, May 2008.
36. S. Tavildar, P. Viswanath, and A. B. Wagner, "The Gaussian many-help-one distributed source coding problem," in Proc. 2006 IEEE Information TheoryWorkshop (ITW'06), Chengdu, China, Oct. 2006, pp. 596-600.
37. S. Jana and R. Blahut, "Achievable region for multiterminal source coding with lossless decoding in all sources except one," in Proc. IEEE Inform. Theory Workshop (ITW'07), Lake Tahoe, CA, Sep. 200.
38. S. Jana, "Unified theory of source coding: Part I-Two terminal problems," arXiv:cs/0508118v2.
39. S. Jana, "Unified theory of source coding: Part II-Multiterminal problems," [Online]. Available: arXiv:cs/0508119v1
40. I. Csiszár, "Linear codes for sources and source networks: Error exponents, universal coding," IEEE Trans. Inf. Theory, vol.IT-28, no.4, pp. 585-592, Jul. 1982.
41. R. Zamir and M. Feder, "On universal quantization by randomized uniform lattice quantizers," IEEE Trans. Inf. Theory, vol.38, no.2, pp. 428-436, Mar. 1992.
42. R. Zamir and M. Feder, "On lattice quantization noise," IEEE Trans. Inf. Theory, vol.42, no.4, pp. 1152-1159, Jul. 1996.
43. S. Shamai (Shitz), S. Verdú, and R. Zamir, "Systematic lossy source/channel coding," IEEE Trans. Inf. Theory, vol.44, no.2, pp. 564-579, Mar. 1998.
44. R. Zamir and T. Berger, "Multiterminal source coding with high resolution," IEEE Trans. Inf. Theory, vol.45, no.1, pp. 106-117, Jan. 1999.
45. R. Zamir, S. Shamai (Shitz), and U. Erez, "Nested linear/lattice codes for structured multiterminal binning," IEEE Trans. Inf. Theory, vol.48, no.6, pp. 1250-1276, Jun. 2002.
46. U. Erez and R. Zamir, "Achieving 1/2log(1+SNR) on the AWGN channel with lattice encoding and decoding," IEEE Trans. Inf. Theory, vol.50, no.10, pp. 2293-2314, Oct. 2004.
47. U. Erez, S. Litsyn, and R. Zamir, "Lattices which are good for (almost) everything," IEEE Trans. Inf. Theory, vol.51, no.10, pp. 3401-3416, Oct. 2005.
48. A. B. Wagner, "An outer bound for distributed compression of linear functions," in Proc. 42nd Annu.Conf. Information Sciences and Systems, Princeton, NJ, Mar. 2008, pp. 435-440.
49. H. Minkowski, "Dichteste gitterförmige Lagerung kongruenter Körper," Nachr. Ges. Wiss. Göttingen, pp. 311-355, 1904.
50. E. Hlawka, "Zur Geometrie der Zahlen," Math. Z., vol.49, pp.285-312, 1944.
51. R. Kershner, "The number of circles covering a set," Amer. J. Math., vol.61, pp. 665-671, 1939.
52. C. A. Rogers, Packing and Covering. Cambridge, U.K.: Cambridge Univ. Press, 1964.
53. H. A. Loeliger, "Averaging bounds for lattices and linear codes," IEEE Trans. Inf. Theory, vol.43, no.6, pp. 1767-1773, Nov. 1997.
54. D. Krithivasan and S. S. Pradhan, "A proof of the existence of good nested lattices," [Online]. Available: http://www.eecs.umich.edu/ techreports/systems/cspl/cspl-384.pdf
55. J. H. Conway and N. J. A. Sloane, Sphere Packings, Lattices and Groups. New York: Springer, 1992.
56. A. Kirac and P. Vaidyanathan, "Results on lattice vector quantization with dithering," IEEE Trans. Circuits and Systems II: Analog Dig. Signal Process., vol.43, pp. 811-826, Dec. 1996.
57. V. A. Vaishampayan, N. J. A. Sloane, and S. D. Servetto, "Multiple-description vector quantization with lattice codebooks: Design and analysis," IEEE Trans. Inf. Theory, vol.47, no.5, pp. 1718-1734, Jul. 2001.
58. Y. Frank-Dayan and R. Zamir, "Dithered lattice-based quantizers for multiple descriptions," IEEE Trans. Inf. Theory, vol.48, no.1, pp. 192-204, Jan. 2002.
59. V. K. Goyal, J. A. Kelner, and J. Kovacevic, "Multiple description vector quantization with a coarse lattice," IEEE Trans. Inf. Theory, vol.48, no.3, pp. 781-788, Mar. 2002.
60. S. N. Diggavi, N. J. A. Sloane, and V. A. Vaishampayan, "Asymmetric multiple description lattice vector quantizers," IEEE Trans. Inf. Theory, vol.48, no.1, pp. 174-191, Jan. 2002.
61. J. Ostergaard, "Multiple-Description Lattice Vector Quantization,"Ph.D. dissertation, Delft Univ. Technol., Delft, The Netherlands, Jun. 200.
62. G. Poltyrev, "On coding without restrictions for the AWGN channel," IEEE Trans. Inf. Theory, vol.40, no.2, pp. 409-417, Mar. 1994.